2026-02-14T10:24:06,541 Created temporary directory: /tmp/pip-ephem-wheel-cache-cvzxc6v4 2026-02-14T10:24:06,543 Created temporary directory: /tmp/pip-build-tracker-shbdv7kg 2026-02-14T10:24:06,544 Initialized build tracking at /tmp/pip-build-tracker-shbdv7kg 2026-02-14T10:24:06,544 Created build tracker: /tmp/pip-build-tracker-shbdv7kg 2026-02-14T10:24:06,545 Entered build tracker: /tmp/pip-build-tracker-shbdv7kg 2026-02-14T10:24:06,545 Created temporary directory: /tmp/pip-wheel-0v164zei 2026-02-14T10:24:06,549 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-02-14T10:24:06,551 Created temporary directory: /tmp/pip-ephem-wheel-cache-x4dg6j6q 2026-02-14T10:24:06,573 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-02-14T10:24:06,576 2 location(s) to search for versions of lm-eval: 2026-02-14T10:24:06,576 * https://pypi.org/simple/lm-eval/ 2026-02-14T10:24:06,576 * https://www.piwheels.org/simple/lm-eval/ 2026-02-14T10:24:06,577 Fetching project page and analyzing links: https://pypi.org/simple/lm-eval/ 2026-02-14T10:24:06,578 Getting page https://pypi.org/simple/lm-eval/ 2026-02-14T10:24:06,579 Found index url https://pypi.org/simple 2026-02-14T10:24:06,716 Fetched page https://pypi.org/simple/lm-eval/ as application/vnd.pypi.simple.v1+json 2026-02-14T10:24:06,723 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/1b/5f/7841febb99c12ffb453d33a67b9841e89dba18c388b644bf22b81d137fc4/lm_eval-0.0.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2026-02-14T10:24:06,724 Found link https://files.pythonhosted.org/packages/21/5a/feb5ff3a1591ca963c54873d39116b0e6a4f80e493e961ac08569709c5d7/lm_eval-0.0.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.0.1 2026-02-14T10:24:06,725 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/f3/a7/63cbce8b51de25fabb1c49f3a3fd1704faaacadb5ed816401f800e4d2dbd/lm_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2026-02-14T10:24:06,726 Found link https://files.pythonhosted.org/packages/c5/fd/edd21b0f258b4ec0260f99f5b2ac3864f7cddc8fb7c83bbb2379a6aab975/lm_eval-0.2.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.2.0 2026-02-14T10:24:06,727 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/61/c5/bff92e6b61fc2b0c1b7ac769633731910152e5176a404912ce7c07329ba0/lm_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2026-02-14T10:24:06,728 Found link https://files.pythonhosted.org/packages/c4/f8/58abc65390a758c8c2e5f1d8bb9b58d7885d02535d5f48de27006453d07e/lm_eval-0.3.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.3.0 2026-02-14T10:24:06,729 Found link https://files.pythonhosted.org/packages/45/e0/05001c2e56e2f8f793189442176432ddb89a2f1f1ef00ea154d0bc00fe37/lm_eval-0.4.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.0 2026-02-14T10:24:06,730 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/49/2d/39f7a25ab663cb45cfc7773b85980f01df44853cc427d00dce94c90b43e6/lm_eval-0.4.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,730 Found link https://files.pythonhosted.org/packages/5a/02/1c7f1ac2f139f4c05af5b94e2c4f88a70404fa0b0c22a5fb04dec0216b03/lm_eval-0.4.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.1 2026-02-14T10:24:06,731 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/0c/5a/64cf703b62ac7ada09a514c16c7136bb4ea7ef3030eb4c3d780900a5a634/lm_eval-0.4.2-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,732 Found link https://files.pythonhosted.org/packages/75/ca/18814743ba3b42d19d8524a4f771e9c3a7aa02cd4c579747a0f513907205/lm_eval-0.4.2.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.2 2026-02-14T10:24:06,733 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/39/2b/eb15fb57ba48b3cebfd302713d680d9917101867e2b5fbfd266e88b89ff3/lm_eval-0.4.3-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,734 Found link https://files.pythonhosted.org/packages/2e/69/dbff28f17e17521735460b25645479e85b58d8ad7ea8488e4672ab52b58b/lm_eval-0.4.3.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.3 2026-02-14T10:24:06,735 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/ad/e1/ac8d7d26b4d6a9eea8859d438691b5d8209a37be2117b3e61f247de2d9e7/lm_eval-0.4.4-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,736 Found link https://files.pythonhosted.org/packages/c6/a8/4dcffd9ad0ddb6c479f93d8316a108a6f9b4d81756c892f150b6c307e8d4/lm_eval-0.4.4.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.4 2026-02-14T10:24:06,736 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/c1/78/fb3ea82c77ccc4dbbd6cafceb15ca01c1cd4d778217d572d65c919b0643f/lm_eval-0.4.5-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,737 Found link https://files.pythonhosted.org/packages/68/7a/cb1993a8d217a5b4c6e52f612a677c4f02c3412d2e3093ecbf6f6413136c/lm_eval-0.4.5.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.5 2026-02-14T10:24:06,738 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/45/b9/1b4e3268b590d9ff16e087685d9526455bb677c3e4d0caeba4451f20c586/lm_eval-0.4.7-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,739 Found link https://files.pythonhosted.org/packages/53/c9/b5d03d5b2bf6819008e377844999fbd04ab00dff0c43728957f1c90a53c5/lm_eval-0.4.7.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.7 2026-02-14T10:24:06,740 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/c3/0b/36d6117f644f3685e6b87005ecd7051d01e9cdcf617e8e671102c1546de2/lm_eval-0.4.8-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2026-02-14T10:24:06,740 Found link https://files.pythonhosted.org/packages/ba/b2/fe23d318c5f645636f9f776c373d1ba68aa55c998894660613a09b0fe2ec/lm_eval-0.4.8.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.8 2026-02-14T10:24:06,741 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/b6/4f/3ab58de3dfee26f693d149824d9d62723f771392c4756becccbcbaaa4e03/lm_eval-0.4.9-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2026-02-14T10:24:06,742 Found link https://files.pythonhosted.org/packages/e5/ab/866d8957cddbb26510e5cf5f7c5ec01e179f82d54d2dafd3a6c5c31fc200/lm_eval-0.4.9.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.9 2026-02-14T10:24:06,743 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/18/ba/3a992d435deaf5461f50417bd7ba38a21831a04520941a9ecf1020dcf900/lm_eval-0.4.9.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2026-02-14T10:24:06,744 Found link https://files.pythonhosted.org/packages/b9/81/943efd4d008080625ddb135d961fc40e78fa75c61f4ce1b4b1244c667571/lm_eval-0.4.9.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.9.1 2026-02-14T10:24:06,745 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/6c/50/3903694e69c94ae8dcec654843cb99799e45137e0d1a0a581009aa592673/lm_eval-0.4.9.2-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-02-14T10:24:06,746 Found link https://files.pythonhosted.org/packages/e1/5e/e6d70f4aa2acd7932a873c51de93ddf2dbd1c43aa6f6c86314ab3c0d279d/lm_eval-0.4.9.2.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.9.2 2026-02-14T10:24:06,746 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/23/5b/d0762a01f140e945aa7a44c92bb0c5c149c2c2917278c02eef6f5053b8e1/lm_eval-0.4.10-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-02-14T10:24:06,747 Found link https://files.pythonhosted.org/packages/7c/1c/858cc03ac7960bc7a1323d40a0d912ebef560825075504238f6721ad8a3a/lm_eval-0.4.10.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.10 2026-02-14T10:24:06,747 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/df/b3/8c2923ad4c4d911307e20ab9c7d7869d3811b5a76fe6dbe53678aafbeb04/lm_eval-0.4.11-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-02-14T10:24:06,748 Found link https://files.pythonhosted.org/packages/18/40/ad60ae17f97902ba4ee67914a94c159552f8643fb4598d1d2430a571f0a2/lm_eval-0.4.11.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.11 2026-02-14T10:24:06,749 Fetching project page and analyzing links: https://www.piwheels.org/simple/lm-eval/ 2026-02-14T10:24:06,750 Getting page https://www.piwheels.org/simple/lm-eval/ 2026-02-14T10:24:06,751 Found index url https://www.piwheels.org/simple 2026-02-14T10:24:06,905 Fetched page https://www.piwheels.org/simple/lm-eval/ as text/html 2026-02-14T10:24:06,910 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.4.10-py3-none-any.whl#sha256=f974c8439950d7e007710fae43c1ff085ba2724b8c9c29456987c442a14ddc4a (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-02-14T10:24:06,911 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.4.9.2-py3-none-any.whl#sha256=6433acae848f5040a05aec1f8b4d946c1874207195592064a0dccbf11e6a3bf7 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-02-14T10:24:06,911 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.9.1-py3-none-any.whl#sha256=97ecff896cf8c8a3461730701532cb297638f594631d30e0a0e64bedacc771ce (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2026-02-14T10:24:06,912 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.9-py3-none-any.whl#sha256=aae7521fd8819d6dd3ae674c07816f449a70669bef1db6cdce2968c21ad1f7af (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2026-02-14T10:24:06,912 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.8-py3-none-any.whl#sha256=1ed005366d8f0154fa200db6e0eb56cc5ef33df2bbd2705d19c742e4283593c8 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2026-02-14T10:24:06,913 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.7-py3-none-any.whl#sha256=3b462a73021c5411e6b4491d07d5c4c009843435a2c9350ae5949fbf4a196ed9 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,914 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.5-py3-none-any.whl#sha256=c1292031153f79a22db4193ed91074a1c57ffaec3d9768215a455efd53ff5f02 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,914 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.4-py3-none-any.whl#sha256=1a6e6b514b470ad4c795439aa4cf9cb88b1360d915c7b3108ae5b47e3f7b36fc (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,915 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.3-py3-none-any.whl#sha256=7f4cb7cbd7ea20f2624f1315e69dfbc884cc187749c85760f9b4ec03e7efe491 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,916 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.2-py3-none-any.whl#sha256=a0bcaff492a09947d8a2b80400f224113b1e313da6a688084711130da18e1af7 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,916 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.1-py3-none-any.whl#sha256=796615edf52f5673187a884a9d77c7d755fe95ca2d16fe77a1f042730eb957b3 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,917 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.0-py3-none-any.whl#sha256=1a863b5f478f2e66e921dbbf2e4dcda06a923021763f01b59c5b03bdd3af01c2 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-02-14T10:24:06,917 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.3.0-py3-none-any.whl#sha256=498b8b8954c1f9c17f46e3ec096e9be6b9c96ee70560ee613a4eb9c7b9d31644 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2026-02-14T10:24:06,918 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.2.0-py3-none-any.whl#sha256=e06d3d7b6016be832e6889cbc9c4787b99156ba57f8feb31d3aeb27304c6558c (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2026-02-14T10:24:06,918 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.0.1-py3-none-any.whl#sha256=0afc289f69286f71017fb9811dfea6cda7c703bf693ad43106fbbff1f164cf14 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2026-02-14T10:24:06,919 Skipping link: not a file: https://www.piwheels.org/simple/lm-eval/ 2026-02-14T10:24:06,920 Skipping link: not a file: https://pypi.org/simple/lm-eval/ 2026-02-14T10:24:06,942 Given no hashes to check 1 links for project 'lm-eval': discarding no candidates 2026-02-14T10:24:06,962 Collecting lm-eval==0.4.11 2026-02-14T10:24:06,964 Created temporary directory: /tmp/pip-unpack-x3237led 2026-02-14T10:24:07,192 Downloading lm_eval-0.4.11.tar.gz (3.2 MB) 2026-02-14T10:24:31,673 Added lm-eval==0.4.11 from https://files.pythonhosted.org/packages/18/40/ad60ae17f97902ba4ee67914a94c159552f8643fb4598d1d2430a571f0a2/lm_eval-0.4.11.tar.gz to build tracker '/tmp/pip-build-tracker-shbdv7kg' 2026-02-14T10:24:31,681 Created temporary directory: /tmp/pip-build-env-d0jwba2v 2026-02-14T10:24:31,686 Installing build dependencies: started 2026-02-14T10:24:31,688 Running command pip subprocess to install build dependencies 2026-02-14T10:24:32,917 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2026-02-14T10:24:33,561 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-02-14T10:24:33,587 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-02-14T10:24:35,317 Collecting setuptools>=64.0 2026-02-14T10:24:35,390 Using cached https://www.piwheels.org/simple/setuptools/setuptools-82.0.0-py3-none-any.whl (1.0 MB) 2026-02-14T10:24:38,394 Installing collected packages: setuptools 2026-02-14T10:24:41,726 Successfully installed setuptools-82.0.0 2026-02-14T10:24:41,993 Installing build dependencies: finished with status 'done' 2026-02-14T10:24:42,001 Getting requirements to build wheel: started 2026-02-14T10:24:42,002 Running command Getting requirements to build wheel 2026-02-14T10:24:43,612 /tmp/pip-build-env-d0jwba2v/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-02-14T10:24:43,613 !! 2026-02-14T10:24:43,614 ******************************************************************************** 2026-02-14T10:24:43,614 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-02-14T10:24:43,615 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-02-14T10:24:43,615 or your builds will no longer be supported. 2026-02-14T10:24:43,616 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-02-14T10:24:43,617 ******************************************************************************** 2026-02-14T10:24:43,618 !! 2026-02-14T10:24:43,618 corresp(dist, value, root_dir) 2026-02-14T10:24:43,708 running egg_info 2026-02-14T10:24:43,714 writing lm_eval.egg-info/PKG-INFO 2026-02-14T10:24:43,735 writing dependency_links to lm_eval.egg-info/dependency_links.txt 2026-02-14T10:24:43,737 writing entry points to lm_eval.egg-info/entry_points.txt 2026-02-14T10:24:43,748 writing requirements to lm_eval.egg-info/requires.txt 2026-02-14T10:24:43,750 writing top-level names to lm_eval.egg-info/top_level.txt 2026-02-14T10:24:47,760 reading manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-02-14T10:24:48,494 reading manifest template 'MANIFEST.in' 2026-02-14T10:24:48,495 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2026-02-14T10:24:48,496 adding license file 'LICENSE.md' 2026-02-14T10:24:50,364 writing manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-02-14T10:24:50,513 Getting requirements to build wheel: finished with status 'done' 2026-02-14T10:24:50,517 Created temporary directory: /tmp/pip-modern-metadata-dacaqr6z 2026-02-14T10:24:50,520 Preparing metadata (pyproject.toml): started 2026-02-14T10:24:50,521 Running command Preparing metadata (pyproject.toml) 2026-02-14T10:24:51,390 /tmp/pip-build-env-d0jwba2v/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-02-14T10:24:51,390 !! 2026-02-14T10:24:51,391 ******************************************************************************** 2026-02-14T10:24:51,392 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-02-14T10:24:51,393 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-02-14T10:24:51,393 or your builds will no longer be supported. 2026-02-14T10:24:51,395 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-02-14T10:24:51,395 ******************************************************************************** 2026-02-14T10:24:51,396 !! 2026-02-14T10:24:51,397 corresp(dist, value, root_dir) 2026-02-14T10:24:51,492 running dist_info 2026-02-14T10:24:51,503 creating /tmp/pip-modern-metadata-dacaqr6z/lm_eval.egg-info 2026-02-14T10:24:51,504 writing /tmp/pip-modern-metadata-dacaqr6z/lm_eval.egg-info/PKG-INFO 2026-02-14T10:24:51,525 writing dependency_links to /tmp/pip-modern-metadata-dacaqr6z/lm_eval.egg-info/dependency_links.txt 2026-02-14T10:24:51,527 writing entry points to /tmp/pip-modern-metadata-dacaqr6z/lm_eval.egg-info/entry_points.txt 2026-02-14T10:24:51,537 writing requirements to /tmp/pip-modern-metadata-dacaqr6z/lm_eval.egg-info/requires.txt 2026-02-14T10:24:51,539 writing top-level names to /tmp/pip-modern-metadata-dacaqr6z/lm_eval.egg-info/top_level.txt 2026-02-14T10:24:51,541 writing manifest file '/tmp/pip-modern-metadata-dacaqr6z/lm_eval.egg-info/SOURCES.txt' 2026-02-14T10:24:55,801 reading manifest file '/tmp/pip-modern-metadata-dacaqr6z/lm_eval.egg-info/SOURCES.txt' 2026-02-14T10:24:55,803 reading manifest template 'MANIFEST.in' 2026-02-14T10:24:55,804 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2026-02-14T10:24:55,805 adding license file 'LICENSE.md' 2026-02-14T10:24:56,304 writing manifest file '/tmp/pip-modern-metadata-dacaqr6z/lm_eval.egg-info/SOURCES.txt' 2026-02-14T10:24:56,330 creating '/tmp/pip-modern-metadata-dacaqr6z/lm_eval-0.4.11.dist-info' 2026-02-14T10:24:56,491 Preparing metadata (pyproject.toml): finished with status 'done' 2026-02-14T10:24:56,500 Source in /tmp/pip-wheel-0v164zei/lm-eval_f8447095123e41069c57d3b31fb8ca06 has version 0.4.11, which satisfies requirement lm-eval==0.4.11 from https://files.pythonhosted.org/packages/18/40/ad60ae17f97902ba4ee67914a94c159552f8643fb4598d1d2430a571f0a2/lm_eval-0.4.11.tar.gz 2026-02-14T10:24:56,501 Removed lm-eval==0.4.11 from https://files.pythonhosted.org/packages/18/40/ad60ae17f97902ba4ee67914a94c159552f8643fb4598d1d2430a571f0a2/lm_eval-0.4.11.tar.gz from build tracker '/tmp/pip-build-tracker-shbdv7kg' 2026-02-14T10:24:56,513 Created temporary directory: /tmp/pip-unpack-5bowe769 2026-02-14T10:24:56,514 Building wheels for collected packages: lm-eval 2026-02-14T10:24:56,519 Created temporary directory: /tmp/pip-wheel-wnlla9wb 2026-02-14T10:24:56,520 Destination directory: /tmp/pip-wheel-wnlla9wb 2026-02-14T10:24:56,522 Building wheel for lm-eval (pyproject.toml): started 2026-02-14T10:24:56,523 Running command Building wheel for lm-eval (pyproject.toml) 2026-02-14T10:24:57,339 /tmp/pip-build-env-d0jwba2v/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-02-14T10:24:57,340 !! 2026-02-14T10:24:57,341 ******************************************************************************** 2026-02-14T10:24:57,342 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-02-14T10:24:57,343 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-02-14T10:24:57,344 or your builds will no longer be supported. 2026-02-14T10:24:57,346 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-02-14T10:24:57,347 ******************************************************************************** 2026-02-14T10:24:57,348 !! 2026-02-14T10:24:57,349 corresp(dist, value, root_dir) 2026-02-14T10:24:57,425 running bdist_wheel 2026-02-14T10:24:57,442 running build 2026-02-14T10:24:57,443 running build_py 2026-02-14T10:24:57,449 creating build/lib/lm_eval 2026-02-14T10:24:57,451 copying lm_eval/defaults.py -> build/lib/lm_eval 2026-02-14T10:24:57,453 copying lm_eval/evaluator.py -> build/lib/lm_eval 2026-02-14T10:24:57,456 copying lm_eval/evaluator_utils.py -> build/lib/lm_eval 2026-02-14T10:24:57,459 copying lm_eval/__main__.py -> build/lib/lm_eval 2026-02-14T10:24:57,461 copying lm_eval/utils.py -> build/lib/lm_eval 2026-02-14T10:24:57,464 copying lm_eval/__init__.py -> build/lib/lm_eval 2026-02-14T10:24:57,466 creating build/lib/lm_eval/prompts 2026-02-14T10:24:57,467 copying lm_eval/prompts/__init__.py -> build/lib/lm_eval/prompts 2026-02-14T10:24:57,471 creating build/lib/lm_eval/filters 2026-02-14T10:24:57,472 copying lm_eval/filters/custom.py -> build/lib/lm_eval/filters 2026-02-14T10:24:57,475 copying lm_eval/filters/decontamination.py -> build/lib/lm_eval/filters 2026-02-14T10:24:57,478 copying lm_eval/filters/selection.py -> build/lib/lm_eval/filters 2026-02-14T10:24:57,480 copying lm_eval/filters/transformation.py -> build/lib/lm_eval/filters 2026-02-14T10:24:57,483 copying lm_eval/filters/__init__.py -> build/lib/lm_eval/filters 2026-02-14T10:24:57,485 copying lm_eval/filters/extraction.py -> build/lib/lm_eval/filters 2026-02-14T10:24:57,490 creating build/lib/lm_eval/loggers 2026-02-14T10:24:57,491 copying lm_eval/loggers/wandb_logger.py -> build/lib/lm_eval/loggers 2026-02-14T10:24:57,494 copying lm_eval/loggers/evaluation_tracker.py -> build/lib/lm_eval/loggers 2026-02-14T10:24:57,499 copying lm_eval/loggers/utils.py -> build/lib/lm_eval/loggers 2026-02-14T10:24:57,504 copying lm_eval/loggers/__init__.py -> build/lib/lm_eval/loggers 2026-02-14T10:24:57,510 creating build/lib/lm_eval/tasks 2026-02-14T10:24:57,512 copying lm_eval/tasks/__init__.py -> build/lib/lm_eval/tasks 2026-02-14T10:24:57,517 creating build/lib/lm_eval/decontamination 2026-02-14T10:24:57,518 copying lm_eval/decontamination/janitor.py -> build/lib/lm_eval/decontamination 2026-02-14T10:24:57,521 copying lm_eval/decontamination/archiver.py -> build/lib/lm_eval/decontamination 2026-02-14T10:24:57,524 copying lm_eval/decontamination/decontaminate.py -> build/lib/lm_eval/decontamination 2026-02-14T10:24:57,526 copying lm_eval/decontamination/__init__.py -> build/lib/lm_eval/decontamination 2026-02-14T10:24:57,529 creating build/lib/lm_eval/models 2026-02-14T10:24:57,530 copying lm_eval/models/hf_vlms.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,534 copying lm_eval/models/winml.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,537 copying lm_eval/models/mistral3.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,540 copying lm_eval/models/nemo_lm.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,543 copying lm_eval/models/huggingface.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,547 copying lm_eval/models/anthropic_llms.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,549 copying lm_eval/models/gguf.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,552 copying lm_eval/models/sglang_causallms.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,556 copying lm_eval/models/dummy.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,560 copying lm_eval/models/vllm_vlms.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,565 copying lm_eval/models/mamba_lm.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,787 copying lm_eval/models/hf_steered.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,790 copying lm_eval/models/optimum_ipex.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,792 copying lm_eval/models/ibm_watsonx_ai.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,795 copying lm_eval/models/openai_completions.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,798 copying lm_eval/models/utils_hf.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,801 copying lm_eval/models/api_models.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,804 copying lm_eval/models/vllm_causallms.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,808 copying lm_eval/models/textsynth.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,810 copying lm_eval/models/neuron_optimum.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,813 copying lm_eval/models/utils.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,817 copying lm_eval/models/sglang_generate_API.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,819 copying lm_eval/models/hf_audiolm.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,822 copying lm_eval/models/__init__.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,824 copying lm_eval/models/optimum_lm.py -> build/lib/lm_eval/models 2026-02-14T10:24:57,826 creating build/lib/lm_eval/caching 2026-02-14T10:24:57,828 copying lm_eval/caching/cache.py -> build/lib/lm_eval/caching 2026-02-14T10:24:57,830 copying lm_eval/caching/__init__.py -> build/lib/lm_eval/caching 2026-02-14T10:24:57,833 creating build/lib/lm_eval/_cli 2026-02-14T10:24:57,834 copying lm_eval/_cli/run.py -> build/lib/lm_eval/_cli 2026-02-14T10:24:57,839 copying lm_eval/_cli/subcommand.py -> build/lib/lm_eval/_cli 2026-02-14T10:24:57,841 copying lm_eval/_cli/validate.py -> build/lib/lm_eval/_cli 2026-02-14T10:24:57,844 copying lm_eval/_cli/ls.py -> build/lib/lm_eval/_cli 2026-02-14T10:24:57,847 copying lm_eval/_cli/utils.py -> build/lib/lm_eval/_cli 2026-02-14T10:24:57,850 copying lm_eval/_cli/__init__.py -> build/lib/lm_eval/_cli 2026-02-14T10:24:57,854 copying lm_eval/_cli/harness.py -> build/lib/lm_eval/_cli 2026-02-14T10:24:57,858 creating build/lib/lm_eval/api 2026-02-14T10:24:57,860 copying lm_eval/api/task.py -> build/lib/lm_eval/api 2026-02-14T10:24:57,897 copying lm_eval/api/group.py -> build/lib/lm_eval/api 2026-02-14T10:24:57,900 copying lm_eval/api/metrics.py -> build/lib/lm_eval/api 2026-02-14T10:24:57,903 copying lm_eval/api/samplers.py -> build/lib/lm_eval/api 2026-02-14T10:24:57,905 copying lm_eval/api/filter.py -> build/lib/lm_eval/api 2026-02-14T10:24:57,908 copying lm_eval/api/registry.py -> build/lib/lm_eval/api 2026-02-14T10:24:57,911 copying lm_eval/api/instance.py -> build/lib/lm_eval/api 2026-02-14T10:24:57,913 copying lm_eval/api/model.py -> build/lib/lm_eval/api 2026-02-14T10:24:57,917 copying lm_eval/api/utils.py -> build/lib/lm_eval/api 2026-02-14T10:24:57,920 copying lm_eval/api/__init__.py -> build/lib/lm_eval/api 2026-02-14T10:24:57,924 creating build/lib/lm_eval/config 2026-02-14T10:24:57,926 copying lm_eval/config/task.py -> build/lib/lm_eval/config 2026-02-14T10:24:57,932 copying lm_eval/config/evaluate_config.py -> build/lib/lm_eval/config 2026-02-14T10:24:57,935 copying lm_eval/config/__init__.py -> build/lib/lm_eval/config 2026-02-14T10:24:57,938 creating build/lib/lm_eval/tasks/copal_id 2026-02-14T10:24:57,939 copying lm_eval/tasks/copal_id/utils.py -> build/lib/lm_eval/tasks/copal_id 2026-02-14T10:24:57,943 creating build/lib/lm_eval/tasks/mimic_repsum 2026-02-14T10:24:57,945 copying lm_eval/tasks/mimic_repsum/utils_perplexity.py -> build/lib/lm_eval/tasks/mimic_repsum 2026-02-14T10:24:57,947 copying lm_eval/tasks/mimic_repsum/utils.py -> build/lib/lm_eval/tasks/mimic_repsum 2026-02-14T10:24:57,950 creating build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:24:57,951 copying lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:24:57,954 copying lm_eval/tasks/arabicmmlu/utils.py -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:24:57,956 creating build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-02-14T10:24:57,958 copying lm_eval/tasks/simple_cooccurrence_bias/utils.py -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-02-14T10:24:57,962 creating build/lib/lm_eval/tasks/winogender 2026-02-14T10:24:57,963 copying lm_eval/tasks/winogender/utils.py -> build/lib/lm_eval/tasks/winogender 2026-02-14T10:24:57,966 creating build/lib/lm_eval/tasks/common_voice 2026-02-14T10:24:57,967 copying lm_eval/tasks/common_voice/utils.py -> build/lib/lm_eval/tasks/common_voice 2026-02-14T10:24:57,970 creating build/lib/lm_eval/tasks/wsc273 2026-02-14T10:24:57,971 copying lm_eval/tasks/wsc273/utils.py -> build/lib/lm_eval/tasks/wsc273 2026-02-14T10:24:58,186 creating build/lib/lm_eval/tasks/fda 2026-02-14T10:24:58,188 copying lm_eval/tasks/fda/task.py -> build/lib/lm_eval/tasks/fda 2026-02-14T10:24:58,192 creating build/lib/lm_eval/tasks/aclue 2026-02-14T10:24:58,193 copying lm_eval/tasks/aclue/_generate_configs.py -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:24:58,198 creating build/lib/lm_eval/tasks/kobest 2026-02-14T10:24:58,199 copying lm_eval/tasks/kobest/utils.py -> build/lib/lm_eval/tasks/kobest 2026-02-14T10:24:58,202 creating build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:24:58,203 copying lm_eval/tasks/basque_bench/utils.py -> build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:24:58,206 creating build/lib/lm_eval/tasks/moral_stories 2026-02-14T10:24:58,207 copying lm_eval/tasks/moral_stories/utils.py -> build/lib/lm_eval/tasks/moral_stories 2026-02-14T10:24:58,210 creating build/lib/lm_eval/tasks/paws-x 2026-02-14T10:24:58,211 copying lm_eval/tasks/paws-x/utils.py -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:24:58,214 copying lm_eval/tasks/paws-x/_generate_config.py -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:24:58,218 creating build/lib/lm_eval/tasks/wikitext 2026-02-14T10:24:58,219 copying lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/lib/lm_eval/tasks/wikitext 2026-02-14T10:24:58,223 creating build/lib/lm_eval/tasks/eus_trivia 2026-02-14T10:24:58,225 copying lm_eval/tasks/eus_trivia/utils.py -> build/lib/lm_eval/tasks/eus_trivia 2026-02-14T10:24:58,229 creating build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:24:58,231 copying lm_eval/tasks/hendrycks_math/utils.py -> build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:24:58,237 creating build/lib/lm_eval/tasks/medtext 2026-02-14T10:24:58,239 copying lm_eval/tasks/medtext/utils_perplexity.py -> build/lib/lm_eval/tasks/medtext 2026-02-14T10:24:58,243 copying lm_eval/tasks/medtext/utils.py -> build/lib/lm_eval/tasks/medtext 2026-02-14T10:24:58,287 creating build/lib/lm_eval/tasks/ceval 2026-02-14T10:24:58,288 copying lm_eval/tasks/ceval/_generate_configs.py -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:24:58,292 creating build/lib/lm_eval/tasks/jsonschema_bench 2026-02-14T10:24:58,294 copying lm_eval/tasks/jsonschema_bench/metrics.py -> build/lib/lm_eval/tasks/jsonschema_bench 2026-02-14T10:24:58,299 creating build/lib/lm_eval/tasks/humaneval_infilling 2026-02-14T10:24:58,301 copying lm_eval/tasks/humaneval_infilling/utils.py -> build/lib/lm_eval/tasks/humaneval_infilling 2026-02-14T10:24:58,306 creating build/lib/lm_eval/tasks/qa4mre 2026-02-14T10:24:58,307 copying lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/lib/lm_eval/tasks/qa4mre 2026-02-14T10:24:58,312 creating build/lib/lm_eval/tasks/webqs 2026-02-14T10:24:58,314 copying lm_eval/tasks/webqs/utils.py -> build/lib/lm_eval/tasks/webqs 2026-02-14T10:24:58,320 creating build/lib/lm_eval/tasks/meqsum 2026-02-14T10:24:58,323 copying lm_eval/tasks/meqsum/utils.py -> build/lib/lm_eval/tasks/meqsum 2026-02-14T10:24:58,329 creating build/lib/lm_eval/tasks/mmlusr 2026-02-14T10:24:58,332 copying lm_eval/tasks/mmlusr/config.py -> build/lib/lm_eval/tasks/mmlusr 2026-02-14T10:24:58,340 creating build/lib/lm_eval/tasks/glianorex 2026-02-14T10:24:58,343 copying lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/lib/lm_eval/tasks/glianorex 2026-02-14T10:24:58,351 creating build/lib/lm_eval/tasks/hellaswag 2026-02-14T10:24:58,355 copying lm_eval/tasks/hellaswag/utils.py -> build/lib/lm_eval/tasks/hellaswag 2026-02-14T10:24:58,362 creating build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:24:58,363 copying lm_eval/tasks/spanish_bench/utils.py -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:24:58,366 creating build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:24:58,368 copying lm_eval/tasks/egymmlu/_generate_configs.py -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:24:58,372 copying lm_eval/tasks/egymmlu/utils.py -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:24:58,376 creating build/lib/lm_eval/tasks/mediqa_qa2019 2026-02-14T10:24:58,378 copying lm_eval/tasks/mediqa_qa2019/utils_perplexity.py -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-02-14T10:24:58,383 copying lm_eval/tasks/mediqa_qa2019/utils.py -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-02-14T10:24:58,391 creating build/lib/lm_eval/tasks/xquad 2026-02-14T10:24:58,393 copying lm_eval/tasks/xquad/utils.py -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:24:58,401 creating build/lib/lm_eval/tasks/swde 2026-02-14T10:24:58,402 copying lm_eval/tasks/swde/task.py -> build/lib/lm_eval/tasks/swde 2026-02-14T10:24:58,405 creating build/lib/lm_eval/tasks/mts_dialog 2026-02-14T10:24:58,407 copying lm_eval/tasks/mts_dialog/utils_perplexity.py -> build/lib/lm_eval/tasks/mts_dialog 2026-02-14T10:24:58,410 copying lm_eval/tasks/mts_dialog/utils.py -> build/lib/lm_eval/tasks/mts_dialog 2026-02-14T10:24:58,417 creating build/lib/lm_eval/tasks/translation 2026-02-14T10:24:58,420 copying lm_eval/tasks/translation/utils.py -> build/lib/lm_eval/tasks/translation 2026-02-14T10:24:58,426 creating build/lib/lm_eval/tasks/race 2026-02-14T10:24:58,428 copying lm_eval/tasks/race/preprocess_race.py -> build/lib/lm_eval/tasks/race 2026-02-14T10:24:58,431 creating build/lib/lm_eval/tasks/bbh 2026-02-14T10:24:58,433 copying lm_eval/tasks/bbh/_generate_configs.py -> build/lib/lm_eval/tasks/bbh 2026-02-14T10:24:58,438 creating build/lib/lm_eval/tasks/mutual 2026-02-14T10:24:58,439 copying lm_eval/tasks/mutual/utils.py -> build/lib/lm_eval/tasks/mutual 2026-02-14T10:24:58,445 creating build/lib/lm_eval/tasks/eq_bench 2026-02-14T10:24:58,447 copying lm_eval/tasks/eq_bench/utils.py -> build/lib/lm_eval/tasks/eq_bench 2026-02-14T10:24:58,454 creating build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:24:58,456 copying lm_eval/tasks/crows_pairs/utils.py -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:24:58,465 creating build/lib/lm_eval/tasks/qasper 2026-02-14T10:24:58,467 copying lm_eval/tasks/qasper/metrics.py -> build/lib/lm_eval/tasks/qasper 2026-02-14T10:24:58,474 copying lm_eval/tasks/qasper/utils.py -> build/lib/lm_eval/tasks/qasper 2026-02-14T10:24:58,483 creating build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:24:58,486 copying lm_eval/tasks/evalita_llm/metrics.py -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:24:58,494 copying lm_eval/tasks/evalita_llm/sum_utils.py -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:24:58,498 copying lm_eval/tasks/evalita_llm/utils.py -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:24:58,504 creating build/lib/lm_eval/tasks/score 2026-02-14T10:24:58,506 copying lm_eval/tasks/score/non_greedy_summarizer.py -> build/lib/lm_eval/tasks/score 2026-02-14T10:24:58,513 copying lm_eval/tasks/score/utils.py -> build/lib/lm_eval/tasks/score 2026-02-14T10:24:58,739 creating build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:24:58,741 copying lm_eval/tasks/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:24:58,966 creating build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:24:58,969 copying lm_eval/tasks/mmlu-pro-plus/utils.py -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:24:58,976 creating build/lib/lm_eval/tasks/winogrande 2026-02-14T10:24:58,978 copying lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/lib/lm_eval/tasks/winogrande 2026-02-14T10:24:58,983 creating build/lib/lm_eval/tasks/agieval 2026-02-14T10:24:58,985 copying lm_eval/tasks/agieval/utils.py -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:24:58,992 creating build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:24:58,995 copying lm_eval/tasks/arab_culture/prompts.py -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:24:59,000 copying lm_eval/tasks/arab_culture/utils_mcq.py -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:24:59,004 copying lm_eval/tasks/arab_culture/_generate_configs.py -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:24:59,008 creating build/lib/lm_eval/tasks/humaneval 2026-02-14T10:24:59,010 copying lm_eval/tasks/humaneval/utils.py -> build/lib/lm_eval/tasks/humaneval 2026-02-14T10:24:59,017 creating build/lib/lm_eval/tasks/blimp 2026-02-14T10:24:59,019 copying lm_eval/tasks/blimp/generate_configs.py -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:24:59,028 creating build/lib/lm_eval/tasks/drop 2026-02-14T10:24:59,031 copying lm_eval/tasks/drop/utils.py -> build/lib/lm_eval/tasks/drop 2026-02-14T10:24:59,039 creating build/lib/lm_eval/tasks/bbq 2026-02-14T10:24:59,042 copying lm_eval/tasks/bbq/utils.py -> build/lib/lm_eval/tasks/bbq 2026-02-14T10:24:59,052 creating build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:24:59,056 copying lm_eval/tasks/catalan_bench/utils.py -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:24:59,277 creating build/lib/lm_eval/tasks/graphwalks 2026-02-14T10:24:59,279 copying lm_eval/tasks/graphwalks/utils.py -> build/lib/lm_eval/tasks/graphwalks 2026-02-14T10:24:59,290 creating build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:24:59,293 copying lm_eval/tasks/truthfulqa-multi/utils.py -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:24:59,299 creating build/lib/lm_eval/tasks/careqa 2026-02-14T10:24:59,301 copying lm_eval/tasks/careqa/utils_perplexity.py -> build/lib/lm_eval/tasks/careqa 2026-02-14T10:24:59,304 copying lm_eval/tasks/careqa/utils_open.py -> build/lib/lm_eval/tasks/careqa 2026-02-14T10:24:59,308 copying lm_eval/tasks/careqa/utils.py -> build/lib/lm_eval/tasks/careqa 2026-02-14T10:24:59,313 creating build/lib/lm_eval/tasks/afrimmlu 2026-02-14T10:24:59,315 copying lm_eval/tasks/afrimmlu/gen_utils.py -> build/lib/lm_eval/tasks/afrimmlu 2026-02-14T10:24:59,320 copying lm_eval/tasks/afrimmlu/utils.py -> build/lib/lm_eval/tasks/afrimmlu 2026-02-14T10:24:59,325 creating build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:24:59,327 copying lm_eval/tasks/galician_bench/utils.py -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:24:59,335 creating build/lib/lm_eval/tasks/french_bench 2026-02-14T10:24:59,337 copying lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:24:59,341 copying lm_eval/tasks/french_bench/utils.py -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:24:59,347 creating build/lib/lm_eval/tasks/groundcocoa 2026-02-14T10:24:59,349 copying lm_eval/tasks/groundcocoa/utils.py -> build/lib/lm_eval/tasks/groundcocoa 2026-02-14T10:24:59,354 creating build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:24:59,356 copying lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:24:59,363 creating build/lib/lm_eval/tasks/xwinograd 2026-02-14T10:24:59,365 copying lm_eval/tasks/xwinograd/utils.py -> build/lib/lm_eval/tasks/xwinograd 2026-02-14T10:24:59,372 creating build/lib/lm_eval/tasks/mathqa 2026-02-14T10:24:59,375 copying lm_eval/tasks/mathqa/utils.py -> build/lib/lm_eval/tasks/mathqa 2026-02-14T10:24:59,382 creating build/lib/lm_eval/tasks/longbench 2026-02-14T10:24:59,384 copying lm_eval/tasks/longbench/metrics.py -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:24:59,391 copying lm_eval/tasks/longbench/utils.py -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:24:59,397 copying lm_eval/tasks/longbench/_generate_config.py -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:24:59,408 creating build/lib/lm_eval/tasks/belebele 2026-02-14T10:24:59,412 copying lm_eval/tasks/belebele/_generate_configs.py -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:24:59,421 creating build/lib/lm_eval/tasks/olaph 2026-02-14T10:24:59,424 copying lm_eval/tasks/olaph/utils_perplexity.py -> build/lib/lm_eval/tasks/olaph 2026-02-14T10:24:59,429 copying lm_eval/tasks/olaph/utils.py -> build/lib/lm_eval/tasks/olaph 2026-02-14T10:24:59,436 creating build/lib/lm_eval/tasks/discrim_eval 2026-02-14T10:24:59,439 copying lm_eval/tasks/discrim_eval/utils.py -> build/lib/lm_eval/tasks/discrim_eval 2026-02-14T10:24:59,448 creating build/lib/lm_eval/tasks/libra 2026-02-14T10:24:59,451 copying lm_eval/tasks/libra/utils.py -> build/lib/lm_eval/tasks/libra 2026-02-14T10:24:59,459 creating build/lib/lm_eval/tasks/mmmu 2026-02-14T10:24:59,460 copying lm_eval/tasks/mmmu/utils.py -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:24:59,465 creating build/lib/lm_eval/tasks/pisa 2026-02-14T10:24:59,467 copying lm_eval/tasks/pisa/utils.py -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:24:59,475 creating build/lib/lm_eval/tasks/csatqa 2026-02-14T10:24:59,478 copying lm_eval/tasks/csatqa/_generate_configs.py -> build/lib/lm_eval/tasks/csatqa 2026-02-14T10:24:59,485 copying lm_eval/tasks/csatqa/utils.py -> build/lib/lm_eval/tasks/csatqa 2026-02-14T10:24:59,492 creating build/lib/lm_eval/tasks/chartqa 2026-02-14T10:24:59,495 copying lm_eval/tasks/chartqa/utils.py -> build/lib/lm_eval/tasks/chartqa 2026-02-14T10:24:59,503 creating build/lib/lm_eval/tasks/cnn_dailymail 2026-02-14T10:24:59,507 copying lm_eval/tasks/cnn_dailymail/utils.py -> build/lib/lm_eval/tasks/cnn_dailymail 2026-02-14T10:24:59,517 creating build/lib/lm_eval/tasks/xnli 2026-02-14T10:24:59,521 copying lm_eval/tasks/xnli/utils.py -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:24:59,966 creating build/lib/lm_eval/tasks/bigbench 2026-02-14T10:24:59,967 copying lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/lib/lm_eval/tasks/bigbench 2026-02-14T10:24:59,971 copying lm_eval/tasks/bigbench/generate_tasks.py -> build/lib/lm_eval/tasks/bigbench 2026-02-14T10:24:59,975 creating build/lib/lm_eval/tasks/babilong 2026-02-14T10:24:59,977 copying lm_eval/tasks/babilong/common_utils.py -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:24:59,982 creating build/lib/lm_eval/tasks/mmlu_prox 2026-02-14T10:24:59,983 copying lm_eval/tasks/mmlu_prox/lang_libs.py -> build/lib/lm_eval/tasks/mmlu_prox 2026-02-14T10:24:59,988 copying lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py -> build/lib/lm_eval/tasks/mmlu_prox 2026-02-14T10:24:59,992 copying lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py -> build/lib/lm_eval/tasks/mmlu_prox 2026-02-14T10:24:59,997 creating build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:24:59,999 copying lm_eval/tasks/eus_exams/configs.py -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:00,002 copying lm_eval/tasks/eus_exams/utils.py -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:00,006 creating build/lib/lm_eval/tasks/afrimgsm 2026-02-14T10:25:00,007 copying lm_eval/tasks/afrimgsm/gen_utils.py -> build/lib/lm_eval/tasks/afrimgsm 2026-02-14T10:25:00,011 copying lm_eval/tasks/afrimgsm/utils.py -> build/lib/lm_eval/tasks/afrimgsm 2026-02-14T10:25:00,015 creating build/lib/lm_eval/tasks/coqa 2026-02-14T10:25:00,017 copying lm_eval/tasks/coqa/utils.py -> build/lib/lm_eval/tasks/coqa 2026-02-14T10:25:00,021 creating build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:00,022 copying lm_eval/tasks/esbbq/utils.py -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:00,027 creating build/lib/lm_eval/tasks/mbpp 2026-02-14T10:25:00,029 copying lm_eval/tasks/mbpp/utils.py -> build/lib/lm_eval/tasks/mbpp 2026-02-14T10:25:00,034 creating build/lib/lm_eval/tasks/aime 2026-02-14T10:25:00,036 copying lm_eval/tasks/aime/utils.py -> build/lib/lm_eval/tasks/aime 2026-02-14T10:25:00,041 creating build/lib/lm_eval/tasks/noticia 2026-02-14T10:25:00,043 copying lm_eval/tasks/noticia/utils.py -> build/lib/lm_eval/tasks/noticia 2026-02-14T10:25:00,047 creating build/lib/lm_eval/tasks/openai-mmmlu 2026-02-14T10:25:00,049 copying lm_eval/tasks/openai-mmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/openai-mmmlu 2026-02-14T10:25:00,052 creating build/lib/lm_eval/tasks/wmt2016 2026-02-14T10:25:00,053 copying lm_eval/tasks/wmt2016/metrics.py -> build/lib/lm_eval/tasks/wmt2016 2026-02-14T10:25:00,056 creating build/lib/lm_eval/tasks/squad_completion 2026-02-14T10:25:00,057 copying lm_eval/tasks/squad_completion/task.py -> build/lib/lm_eval/tasks/squad_completion 2026-02-14T10:25:00,060 creating build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:00,061 copying lm_eval/tasks/mlqa/generate_tasks.py -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:00,063 copying lm_eval/tasks/mlqa/utils.py -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:00,066 creating build/lib/lm_eval/tasks/med_prescriptions 2026-02-14T10:25:00,067 copying lm_eval/tasks/med_prescriptions/utils.py -> build/lib/lm_eval/tasks/med_prescriptions 2026-02-14T10:25:00,072 creating build/lib/lm_eval/tasks/c4 2026-02-14T10:25:00,073 copying lm_eval/tasks/c4/preprocess_c4.py -> build/lib/lm_eval/tasks/c4 2026-02-14T10:25:00,075 creating build/lib/lm_eval/tasks/truthfulqa 2026-02-14T10:25:00,076 copying lm_eval/tasks/truthfulqa/utils.py -> build/lib/lm_eval/tasks/truthfulqa 2026-02-14T10:25:00,079 creating build/lib/lm_eval/tasks/mgsm 2026-02-14T10:25:00,080 copying lm_eval/tasks/mgsm/utils.py -> build/lib/lm_eval/tasks/mgsm 2026-02-14T10:25:00,084 creating build/lib/lm_eval/tasks/mmlu 2026-02-14T10:25:00,084 copying lm_eval/tasks/mmlu/_generate_configs.py -> build/lib/lm_eval/tasks/mmlu 2026-02-14T10:25:00,088 creating build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:00,089 copying lm_eval/tasks/xcopa/utils.py -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:00,091 creating build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:00,092 copying lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:00,094 copying lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:00,096 copying lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:00,098 copying lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:00,100 creating build/lib/lm_eval/tasks/logiqa 2026-02-14T10:25:00,101 copying lm_eval/tasks/logiqa/utils_logiqa.py -> build/lib/lm_eval/tasks/logiqa 2026-02-14T10:25:00,103 creating build/lib/lm_eval/tasks/icelandic_winogrande 2026-02-14T10:25:00,104 copying lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py -> build/lib/lm_eval/tasks/icelandic_winogrande 2026-02-14T10:25:00,107 creating build/lib/lm_eval/tasks/realtoxicityprompts 2026-02-14T10:25:00,107 copying lm_eval/tasks/realtoxicityprompts/metric.py -> build/lib/lm_eval/tasks/realtoxicityprompts 2026-02-14T10:25:00,110 creating build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:00,111 copying lm_eval/tasks/darijammlu/_generate_configs.py -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:00,114 copying lm_eval/tasks/darijammlu/utils.py -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:00,116 creating build/lib/lm_eval/tasks/histoires_morales 2026-02-14T10:25:00,117 copying lm_eval/tasks/histoires_morales/utils.py -> build/lib/lm_eval/tasks/histoires_morales 2026-02-14T10:25:00,119 creating build/lib/lm_eval/tasks/slr_bench 2026-02-14T10:25:00,120 copying lm_eval/tasks/slr_bench/lm_eval_slr_bench.py -> build/lib/lm_eval/tasks/slr_bench 2026-02-14T10:25:00,123 creating build/lib/lm_eval/tasks/med_text_classification 2026-02-14T10:25:00,124 copying lm_eval/tasks/med_text_classification/utils.py -> build/lib/lm_eval/tasks/med_text_classification 2026-02-14T10:25:00,126 creating build/lib/lm_eval/tasks/eus_reading 2026-02-14T10:25:00,128 copying lm_eval/tasks/eus_reading/utils.py -> build/lib/lm_eval/tasks/eus_reading 2026-02-14T10:25:00,130 creating build/lib/lm_eval/tasks/medmcqa 2026-02-14T10:25:00,131 copying lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/lib/lm_eval/tasks/medmcqa 2026-02-14T10:25:00,134 creating build/lib/lm_eval/tasks/medqa 2026-02-14T10:25:00,135 copying lm_eval/tasks/medqa/preprocess_medqa.py -> build/lib/lm_eval/tasks/medqa 2026-02-14T10:25:00,137 creating build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:00,138 copying lm_eval/tasks/paloma/paloma_utils.py -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:00,141 creating build/lib/lm_eval/tasks/darijahellaswag 2026-02-14T10:25:00,142 copying lm_eval/tasks/darijahellaswag/utils.py -> build/lib/lm_eval/tasks/darijahellaswag 2026-02-14T10:25:00,144 creating build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:00,145 copying lm_eval/tasks/cabbq/utils.py -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:00,148 creating build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:00,149 copying lm_eval/tasks/metabench/process_docs_permute.py -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:00,152 copying lm_eval/tasks/metabench/process_docs.py -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:00,155 creating build/lib/lm_eval/tasks/minerva_math 2026-02-14T10:25:00,156 copying lm_eval/tasks/minerva_math/utils.py -> build/lib/lm_eval/tasks/minerva_math 2026-02-14T10:25:00,159 creating build/lib/lm_eval/tasks/ifeval 2026-02-14T10:25:00,160 copying lm_eval/tasks/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/ifeval 2026-02-14T10:25:00,163 copying lm_eval/tasks/ifeval/instructions.py -> build/lib/lm_eval/tasks/ifeval 2026-02-14T10:25:00,166 copying lm_eval/tasks/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/ifeval 2026-02-14T10:25:00,169 copying lm_eval/tasks/ifeval/utils.py -> build/lib/lm_eval/tasks/ifeval 2026-02-14T10:25:00,171 creating build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:00,172 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:00,174 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:00,176 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:00,178 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:00,180 creating build/lib/lm_eval/tasks/scrolls 2026-02-14T10:25:00,181 copying lm_eval/tasks/scrolls/task.py -> build/lib/lm_eval/tasks/scrolls 2026-02-14T10:25:00,185 creating build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:00,186 copying lm_eval/tasks/ruler/essays.py -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:00,188 copying lm_eval/tasks/ruler/qa_utils.py -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:00,190 copying lm_eval/tasks/ruler/niah_utils.py -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:00,192 copying lm_eval/tasks/ruler/fwe_utils.py -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:00,195 copying lm_eval/tasks/ruler/common_utils.py -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:00,197 copying lm_eval/tasks/ruler/vt_utils.py -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:00,199 copying lm_eval/tasks/ruler/cwe_utils.py -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:00,201 copying lm_eval/tasks/ruler/prepare_niah.py -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:00,205 creating build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:00,206 copying lm_eval/tasks/arab_culture_completion/prompts.py -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:00,208 copying lm_eval/tasks/arab_culture_completion/_generate_configs.py -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:00,210 copying lm_eval/tasks/arab_culture_completion/utils_completion.py -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:00,212 creating build/lib/lm_eval/tasks/basqueglue 2026-02-14T10:25:00,213 copying lm_eval/tasks/basqueglue/utils.py -> build/lib/lm_eval/tasks/basqueglue 2026-02-14T10:25:00,216 creating build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:00,217 copying lm_eval/tasks/unitxt/task.py -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:00,220 creating build/lib/lm_eval/tasks/logiqa2 2026-02-14T10:25:00,221 copying lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/lib/lm_eval/tasks/logiqa2 2026-02-14T10:25:00,224 creating build/lib/lm_eval/tasks/lingoly 2026-02-14T10:25:00,225 copying lm_eval/tasks/lingoly/script.py -> build/lib/lm_eval/tasks/lingoly 2026-02-14T10:25:00,227 copying lm_eval/tasks/lingoly/utils.py -> build/lib/lm_eval/tasks/lingoly 2026-02-14T10:25:00,229 creating build/lib/lm_eval/tasks/pubmedqa 2026-02-14T10:25:00,230 copying lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/lib/lm_eval/tasks/pubmedqa 2026-02-14T10:25:00,232 creating build/lib/lm_eval/tasks/meddialog 2026-02-14T10:25:00,233 copying lm_eval/tasks/meddialog/utils_perplexity.py -> build/lib/lm_eval/tasks/meddialog 2026-02-14T10:25:00,236 copying lm_eval/tasks/meddialog/utils.py -> build/lib/lm_eval/tasks/meddialog 2026-02-14T10:25:00,238 creating build/lib/lm_eval/tasks/squadv2 2026-02-14T10:25:00,239 copying lm_eval/tasks/squadv2/task.py -> build/lib/lm_eval/tasks/squadv2 2026-02-14T10:25:00,242 creating build/lib/lm_eval/tasks/hendrycks_ethics 2026-02-14T10:25:00,243 copying lm_eval/tasks/hendrycks_ethics/utils.py -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-02-14T10:25:00,246 creating build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:00,247 copying lm_eval/tasks/cmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:00,249 creating build/lib/lm_eval/tasks/afrixnli 2026-02-14T10:25:00,250 copying lm_eval/tasks/afrixnli/gen_utils.py -> build/lib/lm_eval/tasks/afrixnli 2026-02-14T10:25:00,253 copying lm_eval/tasks/afrixnli/utils.py -> build/lib/lm_eval/tasks/afrixnli 2026-02-14T10:25:00,256 creating build/lib/lm_eval/tasks/egyhellaswag 2026-02-14T10:25:00,257 copying lm_eval/tasks/egyhellaswag/utils.py -> build/lib/lm_eval/tasks/egyhellaswag 2026-02-14T10:25:00,259 creating build/lib/lm_eval/tasks/toxigen 2026-02-14T10:25:00,260 copying lm_eval/tasks/toxigen/utils.py -> build/lib/lm_eval/tasks/toxigen 2026-02-14T10:25:00,263 creating build/lib/lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:00,265 copying lm_eval/tasks/noreval/ask_gec/errant.py -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:00,268 creating build/lib/lm_eval/tasks/noreval/norec 2026-02-14T10:25:00,269 copying lm_eval/tasks/noreval/norec/utils.py -> build/lib/lm_eval/tasks/noreval/norec 2026-02-14T10:25:00,272 creating build/lib/lm_eval/tasks/noreval/norsumm 2026-02-14T10:25:00,273 copying lm_eval/tasks/noreval/norsumm/utils.py -> build/lib/lm_eval/tasks/noreval/norsumm 2026-02-14T10:25:00,277 creating build/lib/lm_eval/tasks/noreval/noridiom 2026-02-14T10:25:00,278 copying lm_eval/tasks/noreval/noridiom/utils.py -> build/lib/lm_eval/tasks/noreval/noridiom 2026-02-14T10:25:00,281 creating build/lib/lm_eval/tasks/noreval/noropenbookqa 2026-02-14T10:25:00,282 copying lm_eval/tasks/noreval/noropenbookqa/utils.py -> build/lib/lm_eval/tasks/noreval/noropenbookqa 2026-02-14T10:25:00,284 creating build/lib/lm_eval/tasks/noreval/norquad 2026-02-14T10:25:00,285 copying lm_eval/tasks/noreval/norquad/utils.py -> build/lib/lm_eval/tasks/noreval/norquad 2026-02-14T10:25:00,290 creating build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:00,292 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:00,294 creating build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:00,295 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:00,299 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-02-14T10:25:00,300 copying lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-02-14T10:25:00,303 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:00,305 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:00,307 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:00,308 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:00,313 creating build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:00,315 copying lm_eval/tasks/tmlu/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:00,317 copying lm_eval/tasks/tmlu/default/utils.py -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:00,320 creating build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:00,322 copying lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:00,325 copying lm_eval/tasks/code_x_glue/code-text/utils.py -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:00,328 creating build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:00,330 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:00,333 creating build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:00,334 copying lm_eval/tasks/acpbench/gen_2shot/acp_utils.py -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:00,338 creating build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:00,339 copying lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:00,347 creating build/lib/lm_eval/tasks/glue/mnli 2026-02-14T10:25:00,348 copying lm_eval/tasks/glue/mnli/utils.py -> build/lib/lm_eval/tasks/glue/mnli 2026-02-14T10:25:00,352 creating build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:00,353 copying lm_eval/tasks/mmlusr/question_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:00,356 creating build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:00,357 copying lm_eval/tasks/mmlusr/answer_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:00,359 creating build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:00,360 copying lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:00,363 creating build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:00,364 copying lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:00,370 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-02-14T10:25:00,371 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-02-14T10:25:00,374 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-02-14T10:25:00,375 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-02-14T10:25:00,377 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:00,378 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:00,381 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-02-14T10:25:00,382 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-02-14T10:25:00,384 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-02-14T10:25:00,385 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-02-14T10:25:00,388 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-02-14T10:25:00,389 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-02-14T10:25:00,391 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:00,392 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:00,395 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-02-14T10:25:00,396 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-02-14T10:25:00,399 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-02-14T10:25:00,400 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-02-14T10:25:00,402 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-02-14T10:25:00,403 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-02-14T10:25:00,406 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-02-14T10:25:00,407 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-02-14T10:25:00,409 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:00,410 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:00,413 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-02-14T10:25:00,414 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-02-14T10:25:00,416 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-02-14T10:25:00,417 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-02-14T10:25:00,420 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-02-14T10:25:00,421 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-02-14T10:25:00,423 creating build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:00,424 copying lm_eval/tasks/bbh/zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:00,427 creating build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:00,428 copying lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:00,432 creating build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2026-02-14T10:25:00,434 copying lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2026-02-14T10:25:00,437 creating build/lib/lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:25:00,438 copying lm_eval/tasks/leaderboard/gpqa/utils.py -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:25:00,440 creating build/lib/lm_eval/tasks/leaderboard/math 2026-02-14T10:25:00,441 copying lm_eval/tasks/leaderboard/math/utils.py -> build/lib/lm_eval/tasks/leaderboard/math 2026-02-14T10:25:00,444 creating build/lib/lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:25:00,445 copying lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:25:00,448 copying lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:25:00,451 copying lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:25:00,454 copying lm_eval/tasks/leaderboard/ifeval/utils.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:25:00,456 creating build/lib/lm_eval/tasks/leaderboard/musr 2026-02-14T10:25:00,457 copying lm_eval/tasks/leaderboard/musr/utils.py -> build/lib/lm_eval/tasks/leaderboard/musr 2026-02-14T10:25:00,460 creating build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:00,461 copying lm_eval/tasks/e2lmc/noor/_generate_configs.py -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:00,464 creating build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-02-14T10:25:00,465 copying lm_eval/tasks/e2lmc/mmlu_early_training/custom_metrics.py -> build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-02-14T10:25:00,467 creating build/lib/lm_eval/tasks/eq_bench/multilingual 2026-02-14T10:25:00,468 copying lm_eval/tasks/eq_bench/multilingual/utils.py -> build/lib/lm_eval/tasks/eq_bench/multilingual 2026-02-14T10:25:00,471 creating build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:00,471 copying lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:00,474 creating build/lib/lm_eval/tasks/score/mmlu_pro 2026-02-14T10:25:00,475 copying lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-02-14T10:25:00,478 creating build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:00,479 copying lm_eval/tasks/score/math/math_grader.py -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:00,481 copying lm_eval/tasks/score/math/utils_math.py -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:00,486 creating build/lib/lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:25:00,488 copying lm_eval/tasks/include/default/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:25:00,490 creating build/lib/lm_eval/tasks/include/default/Dutch 2026-02-14T10:25:00,491 copying lm_eval/tasks/include/default/Dutch/utils.py -> build/lib/lm_eval/tasks/include/default/Dutch 2026-02-14T10:25:00,493 creating build/lib/lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:25:00,494 copying lm_eval/tasks/include/default/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:25:00,496 creating build/lib/lm_eval/tasks/include/default/Georgian 2026-02-14T10:25:00,498 copying lm_eval/tasks/include/default/Georgian/utils.py -> build/lib/lm_eval/tasks/include/default/Georgian 2026-02-14T10:25:00,500 creating build/lib/lm_eval/tasks/include/default/Urdu 2026-02-14T10:25:00,501 copying lm_eval/tasks/include/default/Urdu/utils.py -> build/lib/lm_eval/tasks/include/default/Urdu 2026-02-14T10:25:00,503 creating build/lib/lm_eval/tasks/include/default/Japanese 2026-02-14T10:25:00,504 copying lm_eval/tasks/include/default/Japanese/utils.py -> build/lib/lm_eval/tasks/include/default/Japanese 2026-02-14T10:25:00,507 creating build/lib/lm_eval/tasks/include/default/Korean 2026-02-14T10:25:00,508 copying lm_eval/tasks/include/default/Korean/utils.py -> build/lib/lm_eval/tasks/include/default/Korean 2026-02-14T10:25:00,510 creating build/lib/lm_eval/tasks/include/default/Spanish 2026-02-14T10:25:00,511 copying lm_eval/tasks/include/default/Spanish/utils.py -> build/lib/lm_eval/tasks/include/default/Spanish 2026-02-14T10:25:00,514 creating build/lib/lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:25:00,515 copying lm_eval/tasks/include/default/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:25:00,517 creating build/lib/lm_eval/tasks/include/default/Telugu 2026-02-14T10:25:00,518 copying lm_eval/tasks/include/default/Telugu/utils.py -> build/lib/lm_eval/tasks/include/default/Telugu 2026-02-14T10:25:00,520 creating build/lib/lm_eval/tasks/include/default/Portuguese 2026-02-14T10:25:00,521 copying lm_eval/tasks/include/default/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-02-14T10:25:00,524 creating build/lib/lm_eval/tasks/include/default/Hungarian 2026-02-14T10:25:00,525 copying lm_eval/tasks/include/default/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-02-14T10:25:00,527 creating build/lib/lm_eval/tasks/include/default/Kazakh 2026-02-14T10:25:00,528 copying lm_eval/tasks/include/default/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-02-14T10:25:00,530 creating build/lib/lm_eval/tasks/include/default/Malayalam 2026-02-14T10:25:00,531 copying lm_eval/tasks/include/default/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-02-14T10:25:00,533 creating build/lib/lm_eval/tasks/include/default/Uzbek 2026-02-14T10:25:00,534 copying lm_eval/tasks/include/default/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-02-14T10:25:00,537 creating build/lib/lm_eval/tasks/include/default/Persian 2026-02-14T10:25:00,538 copying lm_eval/tasks/include/default/Persian/utils.py -> build/lib/lm_eval/tasks/include/default/Persian 2026-02-14T10:25:00,540 creating build/lib/lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:25:00,541 copying lm_eval/tasks/include/default/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:25:00,543 creating build/lib/lm_eval/tasks/include/default/Belarusian 2026-02-14T10:25:00,544 copying lm_eval/tasks/include/default/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-02-14T10:25:00,546 creating build/lib/lm_eval/tasks/include/default/Hebrew 2026-02-14T10:25:00,547 copying lm_eval/tasks/include/default/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-02-14T10:25:00,550 creating build/lib/lm_eval/tasks/include/default/Malay 2026-02-14T10:25:00,551 copying lm_eval/tasks/include/default/Malay/utils.py -> build/lib/lm_eval/tasks/include/default/Malay 2026-02-14T10:25:00,553 creating build/lib/lm_eval/tasks/include/default/Bengali 2026-02-14T10:25:00,554 copying lm_eval/tasks/include/default/Bengali/utils.py -> build/lib/lm_eval/tasks/include/default/Bengali 2026-02-14T10:25:00,556 creating build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:00,557 copying lm_eval/tasks/include/default/Chinese/utils.py -> build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:00,560 creating build/lib/lm_eval/tasks/include/default/Polish 2026-02-14T10:25:00,561 copying lm_eval/tasks/include/default/Polish/utils.py -> build/lib/lm_eval/tasks/include/default/Polish 2026-02-14T10:25:00,564 creating build/lib/lm_eval/tasks/include/default/Estonian 2026-02-14T10:25:00,565 copying lm_eval/tasks/include/default/Estonian/utils.py -> build/lib/lm_eval/tasks/include/default/Estonian 2026-02-14T10:25:00,567 creating build/lib/lm_eval/tasks/include/default/Tagalog 2026-02-14T10:25:00,568 copying lm_eval/tasks/include/default/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-02-14T10:25:00,571 creating build/lib/lm_eval/tasks/include/default/Tamil 2026-02-14T10:25:00,572 copying lm_eval/tasks/include/default/Tamil/utils.py -> build/lib/lm_eval/tasks/include/default/Tamil 2026-02-14T10:25:00,574 creating build/lib/lm_eval/tasks/include/default/Croatian 2026-02-14T10:25:00,575 copying lm_eval/tasks/include/default/Croatian/utils.py -> build/lib/lm_eval/tasks/include/default/Croatian 2026-02-14T10:25:00,577 creating build/lib/lm_eval/tasks/include/default/Indonesian 2026-02-14T10:25:00,578 copying lm_eval/tasks/include/default/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-02-14T10:25:00,581 creating build/lib/lm_eval/tasks/include/default/Finnish 2026-02-14T10:25:00,582 copying lm_eval/tasks/include/default/Finnish/utils.py -> build/lib/lm_eval/tasks/include/default/Finnish 2026-02-14T10:25:00,584 creating build/lib/lm_eval/tasks/include/default/Albanian 2026-02-14T10:25:00,585 copying lm_eval/tasks/include/default/Albanian/utils.py -> build/lib/lm_eval/tasks/include/default/Albanian 2026-02-14T10:25:00,588 creating build/lib/lm_eval/tasks/include/default/Serbian 2026-02-14T10:25:00,589 copying lm_eval/tasks/include/default/Serbian/utils.py -> build/lib/lm_eval/tasks/include/default/Serbian 2026-02-14T10:25:00,591 creating build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:00,592 copying lm_eval/tasks/include/default/Russian/utils.py -> build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:00,595 creating build/lib/lm_eval/tasks/include/default/Italian 2026-02-14T10:25:00,596 copying lm_eval/tasks/include/default/Italian/utils.py -> build/lib/lm_eval/tasks/include/default/Italian 2026-02-14T10:25:00,598 creating build/lib/lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:25:00,599 copying lm_eval/tasks/include/default/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:25:00,601 creating build/lib/lm_eval/tasks/include/default/German 2026-02-14T10:25:00,602 copying lm_eval/tasks/include/default/German/utils.py -> build/lib/lm_eval/tasks/include/default/German 2026-02-14T10:25:00,604 creating build/lib/lm_eval/tasks/include/default/Armenian 2026-02-14T10:25:00,605 copying lm_eval/tasks/include/default/Armenian/utils.py -> build/lib/lm_eval/tasks/include/default/Armenian 2026-02-14T10:25:00,608 creating build/lib/lm_eval/tasks/include/default/Basque 2026-02-14T10:25:00,609 copying lm_eval/tasks/include/default/Basque/utils.py -> build/lib/lm_eval/tasks/include/default/Basque 2026-02-14T10:25:00,611 creating build/lib/lm_eval/tasks/include/default/Greek 2026-02-14T10:25:00,612 copying lm_eval/tasks/include/default/Greek/utils.py -> build/lib/lm_eval/tasks/include/default/Greek 2026-02-14T10:25:00,614 creating build/lib/lm_eval/tasks/include/default/French 2026-02-14T10:25:00,615 copying lm_eval/tasks/include/default/French/utils.py -> build/lib/lm_eval/tasks/include/default/French 2026-02-14T10:25:00,618 creating build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:00,619 copying lm_eval/tasks/include/default/Hindi/utils.py -> build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:00,621 creating build/lib/lm_eval/tasks/include/default/Arabic 2026-02-14T10:25:00,622 copying lm_eval/tasks/include/default/Arabic/utils.py -> build/lib/lm_eval/tasks/include/default/Arabic 2026-02-14T10:25:00,624 creating build/lib/lm_eval/tasks/include/default/Turkish 2026-02-14T10:25:00,625 copying lm_eval/tasks/include/default/Turkish/utils.py -> build/lib/lm_eval/tasks/include/default/Turkish 2026-02-14T10:25:00,628 creating build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:25:00,629 copying lm_eval/tasks/include/default/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:25:00,631 creating build/lib/lm_eval/tasks/include/default/Nepali 2026-02-14T10:25:00,632 copying lm_eval/tasks/include/default/Nepali/utils.py -> build/lib/lm_eval/tasks/include/default/Nepali 2026-02-14T10:25:00,635 creating build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:25:00,636 copying lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:25:00,639 creating build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:25:00,639 copying lm_eval/tasks/include/few_shot_en/Dutch/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:25:00,642 creating build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:25:00,643 copying lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:25:00,645 creating build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-02-14T10:25:00,646 copying lm_eval/tasks/include/few_shot_en/Georgian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-02-14T10:25:00,649 creating build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:25:00,650 copying lm_eval/tasks/include/few_shot_en/Urdu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:25:00,652 creating build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:25:00,653 copying lm_eval/tasks/include/few_shot_en/Japanese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:25:00,655 creating build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:25:00,656 copying lm_eval/tasks/include/few_shot_en/Korean/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:25:00,659 creating build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:25:00,660 copying lm_eval/tasks/include/few_shot_en/Spanish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:25:00,662 creating build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:25:00,663 copying lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:25:00,666 creating build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:25:00,667 copying lm_eval/tasks/include/few_shot_en/Telugu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:25:00,669 creating build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:25:00,670 copying lm_eval/tasks/include/few_shot_en/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:25:00,672 creating build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:25:00,673 copying lm_eval/tasks/include/few_shot_en/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:25:00,676 creating build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-02-14T10:25:00,677 copying lm_eval/tasks/include/few_shot_en/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-02-14T10:25:00,679 creating build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:25:00,680 copying lm_eval/tasks/include/few_shot_en/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:25:00,682 creating build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:25:00,683 copying lm_eval/tasks/include/few_shot_en/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:25:00,686 creating build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:25:00,687 copying lm_eval/tasks/include/few_shot_en/Persian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:25:00,689 creating build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:25:00,690 copying lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:25:00,693 creating build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:25:00,694 copying lm_eval/tasks/include/few_shot_en/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:25:00,696 creating build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:25:00,697 copying lm_eval/tasks/include/few_shot_en/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:25:00,699 creating build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:25:00,700 copying lm_eval/tasks/include/few_shot_en/Malay/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:25:00,703 creating build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:25:00,704 copying lm_eval/tasks/include/few_shot_en/Bengali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:25:00,706 creating build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:00,708 copying lm_eval/tasks/include/few_shot_en/Chinese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:00,710 creating build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:25:00,711 copying lm_eval/tasks/include/few_shot_en/Polish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:25:00,713 creating build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:25:00,714 copying lm_eval/tasks/include/few_shot_en/Estonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:25:00,717 creating build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:25:00,718 copying lm_eval/tasks/include/few_shot_en/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:25:00,720 creating build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:25:00,721 copying lm_eval/tasks/include/few_shot_en/Tamil/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:25:00,723 creating build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:25:00,724 copying lm_eval/tasks/include/few_shot_en/Croatian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:25:00,727 creating build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:25:00,728 copying lm_eval/tasks/include/few_shot_en/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:25:00,730 creating build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:25:00,731 copying lm_eval/tasks/include/few_shot_en/Finnish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:25:00,733 creating build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:25:00,734 copying lm_eval/tasks/include/few_shot_en/Albanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:25:00,737 creating build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:25:00,738 copying lm_eval/tasks/include/few_shot_en/Serbian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:25:00,740 creating build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:00,741 copying lm_eval/tasks/include/few_shot_en/Russian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:00,743 creating build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:25:00,745 copying lm_eval/tasks/include/few_shot_en/Italian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:25:00,747 creating build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:25:00,748 copying lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:25:00,751 creating build/lib/lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:25:00,752 copying lm_eval/tasks/include/few_shot_en/German/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:25:00,754 creating build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:25:00,755 copying lm_eval/tasks/include/few_shot_en/Armenian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:25:00,758 creating build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-02-14T10:25:00,759 copying lm_eval/tasks/include/few_shot_en/Basque/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-02-14T10:25:00,761 creating build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:25:00,762 copying lm_eval/tasks/include/few_shot_en/Greek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:25:00,765 creating build/lib/lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:25:00,766 copying lm_eval/tasks/include/few_shot_en/French/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:25:00,768 creating build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:00,769 copying lm_eval/tasks/include/few_shot_en/Hindi/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:00,772 creating build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:25:00,773 copying lm_eval/tasks/include/few_shot_en/Arabic/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:25:00,775 creating build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:25:00,776 copying lm_eval/tasks/include/few_shot_en/Turkish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:25:00,778 creating build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:25:00,779 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:25:00,782 creating build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:25:00,783 copying lm_eval/tasks/include/few_shot_en/Nepali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:25:00,785 creating build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:25:00,786 copying lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:25:00,789 creating build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:25:00,790 copying lm_eval/tasks/include/few_shot_og/Dutch/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:25:00,792 creating build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:25:00,793 copying lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:25:00,795 creating build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-02-14T10:25:00,796 copying lm_eval/tasks/include/few_shot_og/Georgian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-02-14T10:25:00,798 creating build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:25:00,799 copying lm_eval/tasks/include/few_shot_og/Urdu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:25:00,801 creating build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:25:00,802 copying lm_eval/tasks/include/few_shot_og/Japanese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:25:00,805 creating build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:25:00,806 copying lm_eval/tasks/include/few_shot_og/Korean/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:25:00,808 creating build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:25:00,809 copying lm_eval/tasks/include/few_shot_og/Spanish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:25:00,812 creating build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:25:00,813 copying lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:25:00,815 creating build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:25:00,816 copying lm_eval/tasks/include/few_shot_og/Telugu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:25:00,818 creating build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:25:00,819 copying lm_eval/tasks/include/few_shot_og/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:25:00,822 creating build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:25:00,823 copying lm_eval/tasks/include/few_shot_og/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:25:00,825 creating build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-02-14T10:25:00,826 copying lm_eval/tasks/include/few_shot_og/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-02-14T10:25:00,828 creating build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:25:00,829 copying lm_eval/tasks/include/few_shot_og/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:25:00,832 creating build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:25:00,833 copying lm_eval/tasks/include/few_shot_og/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:25:00,835 creating build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:25:00,836 copying lm_eval/tasks/include/few_shot_og/Persian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:25:00,839 creating build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:25:00,840 copying lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:25:00,842 creating build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:25:00,843 copying lm_eval/tasks/include/few_shot_og/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:25:00,845 creating build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:25:00,846 copying lm_eval/tasks/include/few_shot_og/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:25:00,849 creating build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:25:00,849 copying lm_eval/tasks/include/few_shot_og/Malay/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:25:00,852 creating build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:25:00,852 copying lm_eval/tasks/include/few_shot_og/Bengali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:25:00,855 creating build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:00,856 copying lm_eval/tasks/include/few_shot_og/Chinese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:00,858 creating build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:25:00,859 copying lm_eval/tasks/include/few_shot_og/Polish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:25:00,861 creating build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:25:00,862 copying lm_eval/tasks/include/few_shot_og/Estonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:25:00,864 creating build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:25:00,865 copying lm_eval/tasks/include/few_shot_og/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:25:00,868 creating build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:25:00,869 copying lm_eval/tasks/include/few_shot_og/Tamil/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:25:00,871 creating build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:25:00,873 copying lm_eval/tasks/include/few_shot_og/Croatian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:25:00,875 creating build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:25:00,877 copying lm_eval/tasks/include/few_shot_og/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:25:00,879 creating build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:25:00,880 copying lm_eval/tasks/include/few_shot_og/Finnish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:25:00,882 creating build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:25:00,883 copying lm_eval/tasks/include/few_shot_og/Albanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:25:00,886 creating build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:25:00,887 copying lm_eval/tasks/include/few_shot_og/Serbian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:25:00,889 creating build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:00,890 copying lm_eval/tasks/include/few_shot_og/Russian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:00,892 creating build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:25:00,893 copying lm_eval/tasks/include/few_shot_og/Italian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:25:00,896 creating build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:25:00,897 copying lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:25:00,899 creating build/lib/lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:25:00,900 copying lm_eval/tasks/include/few_shot_og/German/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:25:00,902 creating build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:25:00,903 copying lm_eval/tasks/include/few_shot_og/Armenian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:25:00,906 creating build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-02-14T10:25:00,907 copying lm_eval/tasks/include/few_shot_og/Basque/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-02-14T10:25:00,909 creating build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:25:00,911 copying lm_eval/tasks/include/few_shot_og/Greek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:25:00,913 creating build/lib/lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:25:00,914 copying lm_eval/tasks/include/few_shot_og/French/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:25:00,917 creating build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:00,918 copying lm_eval/tasks/include/few_shot_og/Hindi/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:00,920 creating build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:25:00,921 copying lm_eval/tasks/include/few_shot_og/Arabic/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:25:00,924 creating build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:25:00,925 copying lm_eval/tasks/include/few_shot_og/Turkish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:25:00,927 creating build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:25:00,929 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:25:00,931 creating build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:25:00,932 copying lm_eval/tasks/include/few_shot_og/Nepali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:25:00,935 creating build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:00,936 copying lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:00,939 creating build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:00,940 copying lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:00,942 creating build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:00,943 copying lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:00,946 creating build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:00,947 copying lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:00,949 creating build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:00,950 copying lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:00,953 creating build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-02-14T10:25:00,955 copying lm_eval/tasks/catalan_bench/truthfulqa_va/utils.py -> build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-02-14T10:25:00,957 creating build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:00,959 copying lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:00,962 creating build/lib/lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:25:00,964 copying lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:25:00,966 copying lm_eval/tasks/gpqa/zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:25:00,968 creating build/lib/lm_eval/tasks/gpqa/generative 2026-02-14T10:25:00,969 copying lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/generative 2026-02-14T10:25:00,971 copying lm_eval/tasks/gpqa/generative/utils.py -> build/lib/lm_eval/tasks/gpqa/generative 2026-02-14T10:25:00,973 creating build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:25:00,974 copying lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:25:00,976 copying lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:25:00,978 creating build/lib/lm_eval/tasks/gpqa/n_shot 2026-02-14T10:25:00,980 copying lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-02-14T10:25:00,982 copying lm_eval/tasks/gpqa/n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-02-14T10:25:00,984 creating build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:25:00,985 copying lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:25:00,987 copying lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:25:00,990 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:00,992 copying lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:00,994 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:00,995 copying lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:00,997 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:00,998 copying lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:01,000 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:01,001 copying lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:01,004 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:01,005 copying lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:01,008 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:01,009 copying lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:01,011 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:01,012 copying lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:01,015 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:01,016 copying lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:01,018 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:01,019 copying lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:01,022 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:01,023 copying lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:01,025 creating build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:01,026 copying lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:01,029 creating build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:25:01,030 copying lm_eval/tasks/darija_bench/darija_transliteration/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:25:01,033 creating build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:25:01,034 copying lm_eval/tasks/darija_bench/darija_summarization/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:25:01,037 creating build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:25:01,038 copying lm_eval/tasks/darija_bench/darija_sentiment/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:25:01,040 creating build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:01,041 copying lm_eval/tasks/darija_bench/darija_translation/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:01,044 creating build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:01,046 copying lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:01,049 creating build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:01,050 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:01,055 creating build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:01,056 copying lm_eval/tasks/mmlu_prox/it/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:01,058 creating build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:01,059 copying lm_eval/tasks/mmlu_prox/ko/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:01,061 creating build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:01,062 copying lm_eval/tasks/mmlu_prox/af/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:01,065 creating build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:01,066 copying lm_eval/tasks/mmlu_prox/ur/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:01,068 creating build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:01,069 copying lm_eval/tasks/mmlu_prox/th/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:01,072 creating build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:01,073 copying lm_eval/tasks/mmlu_prox/zu/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:01,075 creating build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:01,076 copying lm_eval/tasks/mmlu_prox/fr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:01,079 creating build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:01,080 copying lm_eval/tasks/mmlu_prox/sw/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:01,082 creating build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:01,083 copying lm_eval/tasks/mmlu_prox/es/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:01,086 creating build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:01,087 copying lm_eval/tasks/mmlu_prox/ar/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:01,089 creating build/lib/lm_eval/tasks/mmlu_prox/template 2026-02-14T10:25:01,090 copying lm_eval/tasks/mmlu_prox/template/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/template 2026-02-14T10:25:01,093 creating build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:01,094 copying lm_eval/tasks/mmlu_prox/uk/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:01,096 creating build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:01,097 copying lm_eval/tasks/mmlu_prox/pt/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:01,100 creating build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:01,101 copying lm_eval/tasks/mmlu_prox/bn/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:01,104 creating build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:01,105 copying lm_eval/tasks/mmlu_prox/id/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:01,107 creating build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:01,108 copying lm_eval/tasks/mmlu_prox/hu/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:01,111 creating build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:01,112 copying lm_eval/tasks/mmlu_prox/vi/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:01,114 creating build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:01,115 copying lm_eval/tasks/mmlu_prox/de/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:01,117 creating build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:01,118 copying lm_eval/tasks/mmlu_prox/ja/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:01,121 creating build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:01,121 copying lm_eval/tasks/mmlu_prox/en/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:01,124 creating build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:01,125 copying lm_eval/tasks/mmlu_prox/hi/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:01,127 creating build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:01,128 copying lm_eval/tasks/mmlu_prox/cs/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:01,131 creating build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:01,132 copying lm_eval/tasks/mmlu_prox/ne/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:01,134 creating build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:01,135 copying lm_eval/tasks/mmlu_prox/zh/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:01,137 creating build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:01,138 copying lm_eval/tasks/mmlu_prox/sr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:01,141 creating build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:01,142 copying lm_eval/tasks/mmlu_prox/wo/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:01,144 creating build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:01,145 copying lm_eval/tasks/mmlu_prox/ru/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:01,148 creating build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:01,149 copying lm_eval/tasks/mmlu_prox/yo/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:01,151 creating build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:01,152 copying lm_eval/tasks/mmlu_prox/te/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:01,154 creating build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:01,155 copying lm_eval/tasks/mmlu_prox/mr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:01,158 creating build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:01,159 copying lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:01,162 copying lm_eval/tasks/tmmluplus/default/utils.py -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:01,176 creating build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:01,177 copying lm_eval/tasks/openai-mmmlu/default/utils.py -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:01,180 creating build/lib/lm_eval/tasks/hrm8k/default 2026-02-14T10:25:01,181 copying lm_eval/tasks/hrm8k/default/utils.py -> build/lib/lm_eval/tasks/hrm8k/default 2026-02-14T10:25:01,184 creating build/lib/lm_eval/tasks/hrm8k/en 2026-02-14T10:25:01,185 copying lm_eval/tasks/hrm8k/en/utils.py -> build/lib/lm_eval/tasks/hrm8k/en 2026-02-14T10:25:01,188 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:01,190 copying lm_eval/tasks/llama3/instruct/mmlu_it/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:01,194 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:01,195 copying lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:01,198 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:01,199 copying lm_eval/tasks/llama3/instruct/mmlu_es/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:01,202 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:01,203 copying lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:01,205 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:01,206 copying lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:01,209 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:01,210 copying lm_eval/tasks/llama3/instruct/mmlu_th/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:01,213 creating build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2026-02-14T10:25:01,214 copying lm_eval/tasks/llama3/instruct/arc_challenge/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2026-02-14T10:25:01,216 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:01,217 copying lm_eval/tasks/llama3/instruct/mmlu_de/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:01,221 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:01,222 copying lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:01,224 creating build/lib/lm_eval/tasks/aradice/piqa 2026-02-14T10:25:01,226 copying lm_eval/tasks/aradice/piqa/metrics.py -> build/lib/lm_eval/tasks/aradice/piqa 2026-02-14T10:25:01,228 creating build/lib/lm_eval/tasks/aradice/openbookqa 2026-02-14T10:25:01,229 copying lm_eval/tasks/aradice/openbookqa/metrics.py -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-02-14T10:25:01,231 copying lm_eval/tasks/aradice/openbookqa/utils.py -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-02-14T10:25:01,233 creating build/lib/lm_eval/tasks/aradice/winogrande 2026-02-14T10:25:01,234 copying lm_eval/tasks/aradice/winogrande/metrics.py -> build/lib/lm_eval/tasks/aradice/winogrande 2026-02-14T10:25:01,236 copying lm_eval/tasks/aradice/winogrande/utils.py -> build/lib/lm_eval/tasks/aradice/winogrande 2026-02-14T10:25:01,238 creating build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:25:01,239 copying lm_eval/tasks/aradice/cultural-benchmark/metrics.py -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:25:01,241 copying lm_eval/tasks/aradice/cultural-benchmark/utils.py -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:25:01,243 creating build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:25:01,244 copying lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:25:01,247 creating build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:01,249 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:01,251 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:01,253 creating build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:01,254 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:01,256 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:01,258 creating build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-02-14T10:25:01,260 copying lm_eval/tasks/aradice/boolq/EGY/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-02-14T10:25:01,262 copying lm_eval/tasks/aradice/boolq/EGY/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-02-14T10:25:01,264 creating build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-02-14T10:25:01,265 copying lm_eval/tasks/aradice/boolq/ENG/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-02-14T10:25:01,267 copying lm_eval/tasks/aradice/boolq/ENG/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-02-14T10:25:01,269 creating build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-02-14T10:25:01,270 copying lm_eval/tasks/aradice/boolq/LEV/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-02-14T10:25:01,272 copying lm_eval/tasks/aradice/boolq/LEV/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-02-14T10:25:01,275 creating build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-02-14T10:25:01,276 copying lm_eval/tasks/aradice/boolq/MSA/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-02-14T10:25:01,278 copying lm_eval/tasks/aradice/boolq/MSA/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-02-14T10:25:01,282 creating build/lib/lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:25:01,284 copying lm_eval/tasks/global_mmlu/default/it/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:25:01,286 creating build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:25:01,287 copying lm_eval/tasks/global_mmlu/default/ko/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:25:01,290 creating build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:25:01,291 copying lm_eval/tasks/global_mmlu/default/fr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:25:01,293 creating build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:25:01,294 copying lm_eval/tasks/global_mmlu/default/sw/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:25:01,297 creating build/lib/lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:25:01,298 copying lm_eval/tasks/global_mmlu/default/es/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:25:01,300 creating build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:25:01,301 copying lm_eval/tasks/global_mmlu/default/ar/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:25:01,304 creating build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:25:01,305 copying lm_eval/tasks/global_mmlu/default/pt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:25:01,308 creating build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:25:01,309 copying lm_eval/tasks/global_mmlu/default/bn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:25:01,312 creating build/lib/lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:25:01,313 copying lm_eval/tasks/global_mmlu/default/id/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:25:01,315 creating build/lib/lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:25:01,316 copying lm_eval/tasks/global_mmlu/default/de/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:25:01,318 creating build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:25:01,319 copying lm_eval/tasks/global_mmlu/default/ja/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:25:01,322 creating build/lib/lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:25:01,323 copying lm_eval/tasks/global_mmlu/default/en/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:25:01,325 creating build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:25:01,326 copying lm_eval/tasks/global_mmlu/default/hi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:25:01,328 creating build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:25:01,329 copying lm_eval/tasks/global_mmlu/default/zh/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:25:01,332 creating build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:25:01,333 copying lm_eval/tasks/global_mmlu/default/yo/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:25:01,335 creating build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:01,337 copying lm_eval/tasks/global_mmlu/full/it/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:01,340 creating build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:01,341 copying lm_eval/tasks/global_mmlu/full/ko/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:01,343 creating build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:01,344 copying lm_eval/tasks/global_mmlu/full/tr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:01,347 creating build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:01,348 copying lm_eval/tasks/global_mmlu/full/so/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:01,350 creating build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:01,351 copying lm_eval/tasks/global_mmlu/full/el/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:01,353 creating build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:01,354 copying lm_eval/tasks/global_mmlu/full/ha/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:01,357 creating build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:01,358 copying lm_eval/tasks/global_mmlu/full/nl/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:01,360 creating build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:01,361 copying lm_eval/tasks/global_mmlu/full/fr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:01,364 creating build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:01,365 copying lm_eval/tasks/global_mmlu/full/sw/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:01,367 creating build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:01,368 copying lm_eval/tasks/global_mmlu/full/es/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:01,371 creating build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:01,372 copying lm_eval/tasks/global_mmlu/full/ar/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:01,375 creating build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:01,376 copying lm_eval/tasks/global_mmlu/full/ny/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:01,378 creating build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:01,379 copying lm_eval/tasks/global_mmlu/full/he/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:01,382 creating build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:01,383 copying lm_eval/tasks/global_mmlu/full/ig/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:01,386 creating build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:01,387 copying lm_eval/tasks/global_mmlu/full/ro/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:01,389 creating build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:01,390 copying lm_eval/tasks/global_mmlu/full/mg/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:01,393 creating build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:01,394 copying lm_eval/tasks/global_mmlu/full/uk/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:01,397 creating build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:01,398 copying lm_eval/tasks/global_mmlu/full/si/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:01,400 creating build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:01,401 copying lm_eval/tasks/global_mmlu/full/ms/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:01,404 creating build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:01,405 copying lm_eval/tasks/global_mmlu/full/pt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:01,408 creating build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:01,409 copying lm_eval/tasks/global_mmlu/full/bn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:01,411 creating build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:01,412 copying lm_eval/tasks/global_mmlu/full/am/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:01,415 creating build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:01,416 copying lm_eval/tasks/global_mmlu/full/id/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:01,418 creating build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:01,419 copying lm_eval/tasks/global_mmlu/full/sn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:01,422 creating build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:01,423 copying lm_eval/tasks/global_mmlu/full/vi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:01,425 creating build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:01,426 copying lm_eval/tasks/global_mmlu/full/de/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:01,428 creating build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:01,429 copying lm_eval/tasks/global_mmlu/full/ja/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:01,432 creating build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:01,433 copying lm_eval/tasks/global_mmlu/full/en/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:01,435 creating build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:01,436 copying lm_eval/tasks/global_mmlu/full/hi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:01,439 creating build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:01,440 copying lm_eval/tasks/global_mmlu/full/pl/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:01,442 creating build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:01,443 copying lm_eval/tasks/global_mmlu/full/cs/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:01,445 creating build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:01,446 copying lm_eval/tasks/global_mmlu/full/ne/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:01,449 creating build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:01,450 copying lm_eval/tasks/global_mmlu/full/zh/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:01,452 creating build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:01,453 copying lm_eval/tasks/global_mmlu/full/fil/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:01,456 creating build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:01,457 copying lm_eval/tasks/global_mmlu/full/sr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:01,460 creating build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:01,461 copying lm_eval/tasks/global_mmlu/full/lt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:01,463 creating build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:01,464 copying lm_eval/tasks/global_mmlu/full/fa/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:01,467 creating build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:01,468 copying lm_eval/tasks/global_mmlu/full/ky/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:01,470 creating build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:01,471 copying lm_eval/tasks/global_mmlu/full/ru/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:01,474 creating build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:01,475 copying lm_eval/tasks/global_mmlu/full/yo/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:01,478 creating build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:01,479 copying lm_eval/tasks/global_mmlu/full/sv/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:01,481 creating build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:01,482 copying lm_eval/tasks/global_mmlu/full/te/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:01,485 creating build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:01,486 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:01,491 creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:01,492 copying lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:01,496 creating build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:01,498 copying lm_eval/tasks/click/click_cul/utils.py -> build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:01,501 creating build/lib/lm_eval/tasks/click/click_lang 2026-02-14T10:25:01,502 copying lm_eval/tasks/click/click_lang/utils.py -> build/lib/lm_eval/tasks/click/click_lang 2026-02-14T10:25:01,504 creating build/lib/lm_eval/tasks/ifeval/multilingual 2026-02-14T10:25:01,505 copying lm_eval/tasks/ifeval/multilingual/instructions_registry.py -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-02-14T10:25:01,508 copying lm_eval/tasks/ifeval/multilingual/utils.py -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-02-14T10:25:01,510 creating build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-02-14T10:25:01,511 copying lm_eval/tasks/ifeval/multilingual/instructions/ca_instructions.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-02-14T10:25:01,514 copying lm_eval/tasks/ifeval/multilingual/instructions/es_instructions.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-02-14T10:25:01,518 copying lm_eval/tasks/ifeval/multilingual/instructions/__init__.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-02-14T10:25:01,520 creating build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-02-14T10:25:01,521 copying lm_eval/tasks/ifeval/multilingual/instruction_utils/es_instructions_util.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-02-14T10:25:01,523 copying lm_eval/tasks/ifeval/multilingual/instruction_utils/__init__.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-02-14T10:25:01,525 copying lm_eval/tasks/ifeval/multilingual/instruction_utils/ca_instructions_util.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-02-14T10:25:01,527 creating build/lib/lm_eval/tasks/afrobench/masakhanews 2026-02-14T10:25:01,529 copying lm_eval/tasks/afrobench/masakhanews/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews 2026-02-14T10:25:01,532 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-02-14T10:25:01,533 copying lm_eval/tasks/afrobench/uhura-arc-easy/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-02-14T10:25:01,536 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-02-14T10:25:01,537 copying lm_eval/tasks/afrobench/openai_mmlu/utils.py -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-02-14T10:25:01,539 creating build/lib/lm_eval/tasks/afrobench/adr 2026-02-14T10:25:01,540 copying lm_eval/tasks/afrobench/adr/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/adr 2026-02-14T10:25:01,542 creating build/lib/lm_eval/tasks/afrobench/masakhaner 2026-02-14T10:25:01,543 copying lm_eval/tasks/afrobench/masakhaner/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner 2026-02-14T10:25:01,547 creating build/lib/lm_eval/tasks/afrobench/naijarc 2026-02-14T10:25:01,548 copying lm_eval/tasks/afrobench/naijarc/utils.py -> build/lib/lm_eval/tasks/afrobench/naijarc 2026-02-14T10:25:01,550 creating build/lib/lm_eval/tasks/afrobench/ntrex 2026-02-14T10:25:01,551 copying lm_eval/tasks/afrobench/ntrex/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/ntrex 2026-02-14T10:25:01,554 creating build/lib/lm_eval/tasks/afrobench/salt 2026-02-14T10:25:01,555 copying lm_eval/tasks/afrobench/salt/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/salt 2026-02-14T10:25:01,558 creating build/lib/lm_eval/tasks/afrobench/flores 2026-02-14T10:25:01,559 copying lm_eval/tasks/afrobench/flores/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/flores 2026-02-14T10:25:01,561 creating build/lib/lm_eval/tasks/afrobench/belebele 2026-02-14T10:25:01,562 copying lm_eval/tasks/afrobench/belebele/utils.py -> build/lib/lm_eval/tasks/afrobench/belebele 2026-02-14T10:25:01,565 creating build/lib/lm_eval/tasks/afrobench/mafand 2026-02-14T10:25:01,566 copying lm_eval/tasks/afrobench/mafand/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/mafand 2026-02-14T10:25:01,569 creating build/lib/lm_eval/tasks/afrobench/injongointent 2026-02-14T10:25:01,570 copying lm_eval/tasks/afrobench/injongointent/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent 2026-02-14T10:25:01,573 creating build/lib/lm_eval/tasks/afrobench/afrisenti 2026-02-14T10:25:01,574 copying lm_eval/tasks/afrobench/afrisenti/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-02-14T10:25:01,576 creating build/lib/lm_eval/tasks/afrobench/sib 2026-02-14T10:25:01,577 copying lm_eval/tasks/afrobench/sib/utils.py -> build/lib/lm_eval/tasks/afrobench/sib 2026-02-14T10:25:01,580 creating build/lib/lm_eval/tasks/afrobench/xlsum 2026-02-14T10:25:01,581 copying lm_eval/tasks/afrobench/xlsum/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum 2026-02-14T10:25:01,583 creating build/lib/lm_eval/tasks/afrobench/afriqa 2026-02-14T10:25:01,584 copying lm_eval/tasks/afrobench/afriqa/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa 2026-02-14T10:25:01,587 creating build/lib/lm_eval/tasks/afrobench/masakhapos 2026-02-14T10:25:01,588 copying lm_eval/tasks/afrobench/masakhapos/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-02-14T10:25:01,590 copying lm_eval/tasks/afrobench/masakhapos/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-02-14T10:25:01,592 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:25:01,594 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:25:01,596 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:25:01,597 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:25:01,599 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:25:01,600 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:25:01,603 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:25:01,604 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:25:01,606 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:25:01,607 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:25:01,609 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:01,610 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:01,613 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:01,614 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:01,616 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:01,617 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:01,620 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:01,620 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:01,623 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:01,624 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:01,626 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:25:01,627 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:25:01,629 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:25:01,630 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:25:01,632 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:25:01,633 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:25:01,635 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:25:01,636 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:25:01,639 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:25:01,640 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:25:01,646 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:01,647 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:01,650 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:01,651 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:01,654 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:01,655 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:01,658 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:01,659 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:01,662 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:01,662 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:01,678 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:01,680 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:01,682 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:01,683 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:01,686 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:01,687 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:01,690 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:01,691 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:01,694 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:01,696 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:01,700 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:01,701 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:01,703 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:01,705 copying lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:01,707 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:01,708 copying lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:01,710 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:01,711 copying lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:01,713 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:01,714 copying lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:01,716 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:01,717 copying lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:01,719 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:01,720 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:01,722 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:01,724 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:01,725 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:01,727 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:01,729 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:01,730 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:01,732 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:01,734 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:01,735 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:01,737 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:01,739 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:01,740 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:01,742 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:01,744 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:01,745 copying lm_eval/tasks/afrobench/sib/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:01,748 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:01,750 copying lm_eval/tasks/afrobench/sib/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:01,752 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:01,753 copying lm_eval/tasks/afrobench/sib/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:01,755 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:01,756 copying lm_eval/tasks/afrobench/sib/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:01,759 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:01,760 copying lm_eval/tasks/afrobench/sib/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:01,762 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:01,763 copying lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:01,765 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:01,766 copying lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:01,768 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:01,769 copying lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:01,772 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:01,773 copying lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:01,775 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:01,776 copying lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:01,778 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:01,779 copying lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:01,781 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:01,782 copying lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:01,784 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:01,785 copying lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:01,788 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:01,789 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:01,791 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:01,792 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:01,795 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:01,796 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:01,798 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:01,799 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:01,802 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:01,802 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:01,805 creating build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:01,807 copying lm_eval/tasks/global_piqa/prompted/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:01,809 creating build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:01,810 copying lm_eval/tasks/global_piqa/completions/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:01,812 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-02-14T10:25:01,814 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-02-14T10:25:01,816 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-02-14T10:25:01,817 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-02-14T10:25:01,820 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-02-14T10:25:01,821 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-02-14T10:25:01,823 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-02-14T10:25:01,824 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-02-14T10:25:01,826 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-02-14T10:25:01,827 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-02-14T10:25:01,829 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-02-14T10:25:01,830 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-02-14T10:25:01,832 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:01,833 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:01,835 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-02-14T10:25:01,836 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-02-14T10:25:01,838 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-02-14T10:25:01,839 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-02-14T10:25:01,842 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:01,843 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:01,845 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-02-14T10:25:01,846 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-02-14T10:25:01,848 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-02-14T10:25:01,849 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-02-14T10:25:01,852 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:01,853 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:01,855 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-02-14T10:25:01,856 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-02-14T10:25:01,858 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-02-14T10:25:01,859 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-02-14T10:25:01,861 creating build/lib/lm_eval/tasks/super_glue/multirc 2026-02-14T10:25:01,863 copying lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/multirc 2026-02-14T10:25:01,866 creating build/lib/lm_eval/tasks/super_glue/wsc 2026-02-14T10:25:01,866 copying lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/wsc 2026-02-14T10:25:01,868 copying lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/lib/lm_eval/tasks/super_glue/wsc 2026-02-14T10:25:01,870 creating build/lib/lm_eval/tasks/super_glue/record 2026-02-14T10:25:01,871 copying lm_eval/tasks/super_glue/record/util.py -> build/lib/lm_eval/tasks/super_glue/record 2026-02-14T10:25:01,873 copying lm_eval/tasks/super_glue/record/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/record 2026-02-14T10:25:01,876 creating build/lib/lm_eval/tasks/super_glue/copa 2026-02-14T10:25:01,877 copying lm_eval/tasks/super_glue/copa/utils.py -> build/lib/lm_eval/tasks/super_glue/copa 2026-02-14T10:25:01,879 creating build/lib/lm_eval/tasks/super_glue/cb 2026-02-14T10:25:01,879 copying lm_eval/tasks/super_glue/cb/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/cb 2026-02-14T10:25:01,881 copying lm_eval/tasks/super_glue/cb/aggregate.py -> build/lib/lm_eval/tasks/super_glue/cb 2026-02-14T10:25:01,885 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:01,886 copying lm_eval/tasks/afrixnli/translate/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:01,888 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:01,889 copying lm_eval/tasks/afrixnli/translate/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:01,892 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:01,892 copying lm_eval/tasks/afrixnli/translate/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:01,895 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:01,896 copying lm_eval/tasks/afrixnli/translate/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:01,898 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:01,899 copying lm_eval/tasks/afrixnli/translate/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:01,903 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:01,904 copying lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:01,907 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:01,908 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:01,910 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:01,911 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:01,913 creating build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:01,915 copying lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:01,917 creating build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:01,918 copying lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:01,920 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:01,922 copying lm_eval/tasks/afrixnli/direct/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:01,924 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:01,925 copying lm_eval/tasks/afrixnli/direct/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:01,928 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:01,929 copying lm_eval/tasks/afrixnli/direct/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:01,931 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:01,932 copying lm_eval/tasks/afrixnli/direct/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:01,934 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:01,935 copying lm_eval/tasks/afrixnli/direct/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:01,945 running egg_info 2026-02-14T10:25:01,954 writing lm_eval.egg-info/PKG-INFO 2026-02-14T10:25:01,975 writing dependency_links to lm_eval.egg-info/dependency_links.txt 2026-02-14T10:25:01,976 writing entry points to lm_eval.egg-info/entry_points.txt 2026-02-14T10:25:01,986 writing requirements to lm_eval.egg-info/requires.txt 2026-02-14T10:25:01,988 writing top-level names to lm_eval.egg-info/top_level.txt 2026-02-14T10:25:07,211 reading manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-02-14T10:25:07,952 reading manifest template 'MANIFEST.in' 2026-02-14T10:25:07,953 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2026-02-14T10:25:07,954 adding license file 'LICENSE.md' 2026-02-14T10:25:08,726 writing manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-02-14T10:25:12,063 copying lm_eval/tasks/copal_id/standard.yaml -> build/lib/lm_eval/tasks/copal_id 2026-02-14T10:25:12,066 copying lm_eval/tasks/copal_id/colloquial.yaml -> build/lib/lm_eval/tasks/copal_id 2026-02-14T10:25:12,069 creating build/lib/lm_eval/tasks/noreval/norrewrite-instruct 2026-02-14T10:25:12,070 copying lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml -> build/lib/lm_eval/tasks/noreval/norrewrite-instruct 2026-02-14T10:25:12,073 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:12,075 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:12,078 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:12,081 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:12,083 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:12,086 creating build/lib/lm_eval/tasks/noreval/ncb 2026-02-14T10:25:12,087 copying lm_eval/tasks/noreval/ncb/ncb.yaml -> build/lib/lm_eval/tasks/noreval/ncb 2026-02-14T10:25:12,090 creating build/lib/lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:12,091 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:12,094 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:12,097 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:12,099 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:12,102 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:12,104 creating build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:12,106 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:12,109 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:12,111 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:12,114 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:12,117 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:12,119 creating build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:12,121 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:12,123 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:12,126 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:12,128 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:12,130 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:12,133 creating build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:12,134 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:12,137 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:12,139 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:12,142 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:12,144 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:12,147 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:12,149 creating build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:12,151 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:12,153 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:12,156 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:12,158 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:12,161 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:12,164 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:12,166 creating build/lib/lm_eval/tasks/noreval/norsummarize-instruct 2026-02-14T10:25:12,168 copying lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml -> build/lib/lm_eval/tasks/noreval/norsummarize-instruct 2026-02-14T10:25:12,171 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-02-14T10:25:12,173 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-02-14T10:25:12,176 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-02-14T10:25:12,178 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-02-14T10:25:12,181 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-02-14T10:25:12,183 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-02-14T10:25:12,185 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-02-14T10:25:12,188 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-02-14T10:25:12,190 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-02-14T10:25:12,193 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-02-14T10:25:12,195 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-02-14T10:25:12,196 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-02-14T10:25:12,199 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-02-14T10:25:12,202 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-02-14T10:25:12,204 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-02-14T10:25:12,207 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-02-14T10:25:12,208 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-02-14T10:25:12,211 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-02-14T10:25:12,213 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-02-14T10:25:12,215 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-02-14T10:25:12,218 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:12,221 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:12,223 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:12,226 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:12,228 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:12,231 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:12,233 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:12,236 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:12,238 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:12,241 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:12,244 creating build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:12,245 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:12,248 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:12,250 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:12,253 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:12,256 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:12,258 creating build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:12,259 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:12,262 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:12,264 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:12,267 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:12,269 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:12,272 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:12,274 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:12,277 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:12,279 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:12,281 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:12,284 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:12,286 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:12,289 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:12,291 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:12,294 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:12,296 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:12,298 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:12,301 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:12,304 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:12,306 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:12,309 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:12,311 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:12,313 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:12,315 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:12,317 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:12,320 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:12,322 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:12,324 creating build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:12,325 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:12,328 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:12,330 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:12,332 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:12,335 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:12,337 creating build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:12,338 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:12,341 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:12,344 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:12,346 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:12,349 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:12,351 creating build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:12,352 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:12,354 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:12,357 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:12,359 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:12,361 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:12,363 creating build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:12,365 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:12,370 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:12,372 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:12,374 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:12,376 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:12,378 copying lm_eval/tasks/noreval/norquad/norquad_p1.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-02-14T10:25:12,380 copying lm_eval/tasks/noreval/norquad/norquad_p0.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-02-14T10:25:12,382 copying lm_eval/tasks/noreval/norquad/norquad_p2.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-02-14T10:25:12,384 copying lm_eval/tasks/noreval/norquad/norquad_p3.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-02-14T10:25:12,386 copying lm_eval/tasks/noreval/norquad/norquad_p4.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-02-14T10:25:12,388 creating build/lib/lm_eval/tasks/prost 2026-02-14T10:25:12,389 copying lm_eval/tasks/prost/corypaik_prost.yaml -> build/lib/lm_eval/tasks/prost 2026-02-14T10:25:12,391 copying lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml -> build/lib/lm_eval/tasks/mimic_repsum 2026-02-14T10:25:12,393 copying lm_eval/tasks/mimic_repsum/mimic_repsum.yaml -> build/lib/lm_eval/tasks/mimic_repsum 2026-02-14T10:25:12,395 copying lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,398 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,400 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,402 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,404 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,405 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,408 copying lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,409 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,412 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,414 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,416 copying lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,418 copying lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,420 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,422 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,424 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,426 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,428 copying lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,430 copying lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,432 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,434 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,436 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,438 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,440 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,442 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,444 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,446 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,448 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,450 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,452 copying lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,454 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,457 copying lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,459 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,461 copying lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,463 copying lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,465 copying lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,467 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,469 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,471 copying lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,474 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,476 copying lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,478 copying lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,480 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,482 copying lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,484 copying lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,486 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,488 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:12,490 creating build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,491 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,493 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,495 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,497 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,499 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,501 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,504 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,507 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,509 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,511 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,513 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,515 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,517 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,519 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,521 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,523 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,525 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,528 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,530 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,532 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,534 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,536 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,538 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,540 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,542 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,544 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,546 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,548 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,550 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,552 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,554 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,556 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,558 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,560 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,562 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,564 copying lm_eval/tasks/lm_syneval/lm_syneval_group.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,566 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,568 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,570 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,572 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,574 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,576 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,578 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,580 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,582 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,584 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,586 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,589 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,591 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,593 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,595 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,597 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,599 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,601 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,603 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,606 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,607 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,609 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,611 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,613 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,615 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,617 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,619 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,621 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,623 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,625 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,627 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,630 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,632 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,634 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,636 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,638 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,640 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:12,642 copying lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-02-14T10:25:12,644 copying lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-02-14T10:25:12,646 copying lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,648 copying lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,650 copying lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,653 copying lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,655 copying lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,657 copying lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,659 copying lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,661 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,663 copying lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,665 copying lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,667 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,669 copying lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,671 copying lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,673 copying lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,675 copying lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,677 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,679 copying lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,681 copying lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,683 copying lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,685 copying lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,687 copying lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,689 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,691 copying lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,693 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,696 copying lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,698 copying lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,700 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,702 copying lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,704 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,706 copying lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,708 copying lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,710 copying lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:12,712 creating build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,713 copying lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,715 copying lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,717 copying lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,720 copying lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,722 copying lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,724 copying lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,726 copying lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,728 copying lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,729 copying lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,731 copying lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,733 copying lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:12,736 creating build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:12,737 copying lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:12,740 copying lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:12,742 copying lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:12,745 copying lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:12,747 copying lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:12,750 copying lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:12,752 copying lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:12,755 copying lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:12,758 copying lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:12,760 creating build/lib/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:12,761 copying lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:12,763 copying lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:12,765 copying lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:12,767 copying lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:12,769 copying lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:12,771 copying lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:12,773 copying lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:12,775 copying lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:12,777 copying lm_eval/tasks/turkishmmlu/config/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:12,779 creating build/lib/lm_eval/tasks/mastermind 2026-02-14T10:25:12,780 copying lm_eval/tasks/mastermind/mastermind_35_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2026-02-14T10:25:12,782 copying lm_eval/tasks/mastermind/mastermind_46_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2026-02-14T10:25:12,785 copying lm_eval/tasks/mastermind/mastermind_24_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2026-02-14T10:25:12,787 copying lm_eval/tasks/mastermind/mastermind_35_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2026-02-14T10:25:12,789 copying lm_eval/tasks/mastermind/mastermind_46_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2026-02-14T10:25:12,791 copying lm_eval/tasks/mastermind/mastermind_24_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2026-02-14T10:25:12,793 creating build/lib/lm_eval/tasks/sciq 2026-02-14T10:25:12,794 copying lm_eval/tasks/sciq/sciq.yaml -> build/lib/lm_eval/tasks/sciq 2026-02-14T10:25:12,796 copying lm_eval/tasks/winogender/winogender_male.yaml -> build/lib/lm_eval/tasks/winogender 2026-02-14T10:25:12,798 copying lm_eval/tasks/winogender/winogender_female.yaml -> build/lib/lm_eval/tasks/winogender 2026-02-14T10:25:12,800 copying lm_eval/tasks/winogender/winogender.yaml -> build/lib/lm_eval/tasks/winogender 2026-02-14T10:25:12,802 copying lm_eval/tasks/winogender/winogender_neutral.yaml -> build/lib/lm_eval/tasks/winogender 2026-02-14T10:25:12,803 copying lm_eval/tasks/winogender/winogender_gotcha_male.yaml -> build/lib/lm_eval/tasks/winogender 2026-02-14T10:25:12,805 copying lm_eval/tasks/winogender/winogender_gotcha_female.yaml -> build/lib/lm_eval/tasks/winogender 2026-02-14T10:25:12,807 copying lm_eval/tasks/winogender/winogender_gotcha.yaml -> build/lib/lm_eval/tasks/winogender 2026-02-14T10:25:12,809 copying lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:12,811 copying lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:12,813 copying lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:12,815 copying lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:12,817 copying lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:12,819 copying lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:12,821 copying lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:12,823 creating build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,824 copying lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,826 copying lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,828 copying lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,830 copying lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,832 copying lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,834 copying lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,836 copying lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,838 copying lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,840 copying lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,843 copying lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,845 copying lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,847 copying lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:12,849 copying lm_eval/tasks/common_voice/common_voice_en.yaml -> build/lib/lm_eval/tasks/common_voice 2026-02-14T10:25:12,851 copying lm_eval/tasks/wsc273/default.yaml -> build/lib/lm_eval/tasks/wsc273 2026-02-14T10:25:12,853 creating build/lib/lm_eval/tasks/lambada 2026-02-14T10:25:12,854 copying lm_eval/tasks/lambada/lambada_standard.yaml -> build/lib/lm_eval/tasks/lambada 2026-02-14T10:25:12,856 copying lm_eval/tasks/lambada/lambada_openai.yaml -> build/lib/lm_eval/tasks/lambada 2026-02-14T10:25:12,858 copying lm_eval/tasks/fda/fda.yaml -> build/lib/lm_eval/tasks/fda 2026-02-14T10:25:12,860 creating build/lib/lm_eval/tasks/lambada_cloze 2026-02-14T10:25:12,861 copying lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze 2026-02-14T10:25:12,863 copying lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze 2026-02-14T10:25:12,865 copying lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,867 copying lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,869 copying lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,871 copying lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,873 copying lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,875 copying lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,877 copying lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,879 copying lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,881 copying lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,883 copying lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,885 copying lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,887 copying lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,889 copying lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,891 copying lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,893 copying lm_eval/tasks/aclue/_aclue.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,895 copying lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:12,897 creating build/lib/lm_eval/tasks/anli 2026-02-14T10:25:12,898 copying lm_eval/tasks/anli/anli_r1.yaml -> build/lib/lm_eval/tasks/anli 2026-02-14T10:25:12,900 copying lm_eval/tasks/anli/anli_r2.yaml -> build/lib/lm_eval/tasks/anli 2026-02-14T10:25:12,902 copying lm_eval/tasks/anli/anli_r3.yaml -> build/lib/lm_eval/tasks/anli 2026-02-14T10:25:12,904 creating build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:12,905 copying lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:12,908 copying lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:12,910 copying lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:12,913 copying lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:12,915 copying lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:12,917 copying lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:12,919 copying lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:12,922 creating build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:12,923 copying lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:12,926 copying lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:12,928 copying lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:12,930 copying lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:12,932 copying lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:12,934 copying lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:12,937 copying lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:12,939 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:12,941 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:12,944 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:12,946 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:12,949 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:12,952 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:12,955 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:12,957 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:12,960 copying lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:12,962 copying lm_eval/tasks/acpbench/gen_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:12,964 copying lm_eval/tasks/acpbench/gen_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:12,967 copying lm_eval/tasks/acpbench/gen_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:12,971 copying lm_eval/tasks/acpbench/gen_2shot/next_act.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:12,973 copying lm_eval/tasks/acpbench/gen_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:12,975 copying lm_eval/tasks/acpbench/gen_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:12,977 copying lm_eval/tasks/acpbench/gen_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:12,980 copying lm_eval/tasks/kobest/kobest_wic.yaml -> build/lib/lm_eval/tasks/kobest 2026-02-14T10:25:12,982 copying lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/lib/lm_eval/tasks/kobest 2026-02-14T10:25:12,984 copying lm_eval/tasks/kobest/_kobest.yaml -> build/lib/lm_eval/tasks/kobest 2026-02-14T10:25:12,986 copying lm_eval/tasks/kobest/kobest_copa.yaml -> build/lib/lm_eval/tasks/kobest 2026-02-14T10:25:12,988 copying lm_eval/tasks/kobest/kobest_boolq.yaml -> build/lib/lm_eval/tasks/kobest 2026-02-14T10:25:12,990 copying lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/lib/lm_eval/tasks/kobest 2026-02-14T10:25:12,992 copying lm_eval/tasks/basque_bench/arc_eu_challenge.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:25:12,994 copying lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:25:12,997 copying lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:25:12,999 copying lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:25:13,003 copying lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:25:13,005 copying lm_eval/tasks/basque_bench/basque_bench.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:25:13,007 copying lm_eval/tasks/basque_bench/paws_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:25:13,009 copying lm_eval/tasks/basque_bench/mgsm_native_cot_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:25:13,011 copying lm_eval/tasks/basque_bench/arc_eu_easy.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:25:13,013 copying lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,015 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,017 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,019 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,021 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,023 copying lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,025 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,027 copying lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,029 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,031 copying lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,033 copying lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,035 copying lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,037 copying lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,039 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,041 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,043 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,046 copying lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:13,048 copying lm_eval/tasks/moral_stories/moral_stories.yaml -> build/lib/lm_eval/tasks/moral_stories 2026-02-14T10:25:13,050 creating build/lib/lm_eval/tasks/piqa 2026-02-14T10:25:13,051 copying lm_eval/tasks/piqa/piqa.yaml -> build/lib/lm_eval/tasks/piqa 2026-02-14T10:25:13,053 copying lm_eval/tasks/paws-x/paws_de.yaml -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:25:13,055 copying lm_eval/tasks/paws-x/paws_zh.yaml -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:25:13,057 copying lm_eval/tasks/paws-x/paws_ko.yaml -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:25:13,059 copying lm_eval/tasks/paws-x/paws_fr.yaml -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:25:13,061 copying lm_eval/tasks/paws-x/paws_en.yaml -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:25:13,063 copying lm_eval/tasks/paws-x/paws_es.yaml -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:25:13,065 copying lm_eval/tasks/paws-x/paws_ja.yaml -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:25:13,067 copying lm_eval/tasks/paws-x/_pawsx.yaml -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:25:13,069 creating build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,070 copying lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,073 copying lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,075 copying lm_eval/tasks/bhs/hindi-S_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,077 copying lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,079 copying lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,081 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,083 copying lm_eval/tasks/bhs/bhs_basque.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,085 copying lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,087 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,089 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,091 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,093 copying lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,094 copying lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,096 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,098 copying lm_eval/tasks/bhs/bhs_hindi.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,100 copying lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,102 copying lm_eval/tasks/bhs/bhs_swahili.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,104 copying lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,107 copying lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,109 copying lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,110 copying lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,112 copying lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,114 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,116 copying lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,118 copying lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:13,120 copying lm_eval/tasks/wikitext/wikitext.yaml -> build/lib/lm_eval/tasks/wikitext 2026-02-14T10:25:13,122 copying lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/lib/lm_eval/tasks/eus_trivia 2026-02-14T10:25:13,124 copying lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:25:13,127 copying lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:25:13,129 copying lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:25:13,131 copying lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:25:13,133 copying lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:25:13,135 copying lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:25:13,137 copying lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:25:13,139 copying lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:25:13,141 copying lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:25:13,143 copying lm_eval/tasks/medtext/medtext_perplexity.yaml -> build/lib/lm_eval/tasks/medtext 2026-02-14T10:25:13,146 copying lm_eval/tasks/medtext/medtext.yaml -> build/lib/lm_eval/tasks/medtext 2026-02-14T10:25:13,148 copying lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,150 copying lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,151 copying lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,153 copying lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,155 copying lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,157 copying lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,159 copying lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,161 copying lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,163 copying lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,165 copying lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,167 copying lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,169 copying lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,171 copying lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,173 copying lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,175 copying lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,177 copying lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,179 copying lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,181 copying lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,183 copying lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,185 copying lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,187 copying lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,189 copying lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,191 copying lm_eval/tasks/ceval/_ceval-valid.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,193 copying lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,196 copying lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,198 copying lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,200 copying lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,202 copying lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,204 copying lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,210 copying lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,212 copying lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,214 copying lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,216 copying lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,218 copying lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,220 copying lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,222 copying lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,224 copying lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,226 copying lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,228 copying lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,230 copying lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,231 copying lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,233 copying lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,235 copying lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,237 copying lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,239 copying lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,241 copying lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,243 copying lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,245 copying lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,248 copying lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,249 copying lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,252 copying lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,254 copying lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,256 copying lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:13,258 creating build/lib/lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:13,259 copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:13,262 copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:13,264 copying lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:13,266 copying lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:13,268 creating build/lib/lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:13,269 copying lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:13,271 copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:13,273 copying lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:13,275 copying lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:13,277 copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:13,279 copying lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:13,281 copying lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:13,284 creating build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,285 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,287 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,289 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,291 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,293 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,296 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,298 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,300 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,302 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,304 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,306 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,308 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,310 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,313 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:13,315 creating build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,315 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,318 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,320 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,322 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,324 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,326 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,328 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,330 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,332 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,334 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,336 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,338 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,341 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,342 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:13,344 creating build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,345 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,347 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,349 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,351 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,353 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,355 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,357 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,359 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,361 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,363 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,365 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,367 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,369 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:13,371 creating build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,372 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,374 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,377 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,379 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,381 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,383 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,385 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,387 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,389 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,391 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,393 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,395 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,397 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:13,399 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2026-02-14T10:25:13,401 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2026-02-14T10:25:13,403 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2026-02-14T10:25:13,405 creating build/lib/lm_eval/tasks/babi 2026-02-14T10:25:13,406 copying lm_eval/tasks/babi/babi.yaml -> build/lib/lm_eval/tasks/babi 2026-02-14T10:25:13,408 creating build/lib/lm_eval/tasks/glue/qqp 2026-02-14T10:25:13,409 copying lm_eval/tasks/glue/qqp/default.yaml -> build/lib/lm_eval/tasks/glue/qqp 2026-02-14T10:25:13,411 creating build/lib/lm_eval/tasks/glue/rte 2026-02-14T10:25:13,412 copying lm_eval/tasks/glue/rte/default.yaml -> build/lib/lm_eval/tasks/glue/rte 2026-02-14T10:25:13,415 creating build/lib/lm_eval/tasks/glue/wnli 2026-02-14T10:25:13,416 copying lm_eval/tasks/glue/wnli/default.yaml -> build/lib/lm_eval/tasks/glue/wnli 2026-02-14T10:25:13,419 creating build/lib/lm_eval/tasks/glue/mrpc 2026-02-14T10:25:13,420 copying lm_eval/tasks/glue/mrpc/default.yaml -> build/lib/lm_eval/tasks/glue/mrpc 2026-02-14T10:25:13,423 creating build/lib/lm_eval/tasks/glue/qnli 2026-02-14T10:25:13,424 copying lm_eval/tasks/glue/qnli/default.yaml -> build/lib/lm_eval/tasks/glue/qnli 2026-02-14T10:25:13,426 creating build/lib/lm_eval/tasks/glue/cola 2026-02-14T10:25:13,427 copying lm_eval/tasks/glue/cola/default.yaml -> build/lib/lm_eval/tasks/glue/cola 2026-02-14T10:25:13,430 copying lm_eval/tasks/glue/mnli/default.yaml -> build/lib/lm_eval/tasks/glue/mnli 2026-02-14T10:25:13,432 copying lm_eval/tasks/glue/mnli/mismatch.yaml -> build/lib/lm_eval/tasks/glue/mnli 2026-02-14T10:25:13,434 creating build/lib/lm_eval/tasks/glue/sst2 2026-02-14T10:25:13,435 copying lm_eval/tasks/glue/sst2/default.yaml -> build/lib/lm_eval/tasks/glue/sst2 2026-02-14T10:25:13,437 creating build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,438 copying lm_eval/tasks/longbench2/event_order.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,440 copying lm_eval/tasks/longbench2/news_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,442 copying lm_eval/tasks/longbench2/fin_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,444 copying lm_eval/tasks/longbench2/table.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,446 copying lm_eval/tasks/longbench2/detective.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,448 copying lm_eval/tasks/longbench2/user_guide.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,450 copying lm_eval/tasks/longbench2/_longbench2_history.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,452 copying lm_eval/tasks/longbench2/legal_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,454 copying lm_eval/tasks/longbench2/_longbench2_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,456 copying lm_eval/tasks/longbench2/_longbench2_single.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,458 copying lm_eval/tasks/longbench2/govt_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,460 copying lm_eval/tasks/longbench2/govt_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,462 copying lm_eval/tasks/longbench2/_longbench2_structured.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,465 copying lm_eval/tasks/longbench2/many_shot.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,467 copying lm_eval/tasks/longbench2/translate.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,469 copying lm_eval/tasks/longbench2/_longbench2_incontext.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,471 copying lm_eval/tasks/longbench2/lit_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,473 copying lm_eval/tasks/longbench2/_longbench2.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,475 copying lm_eval/tasks/longbench2/legal_single.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,477 copying lm_eval/tasks/longbench2/academic_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,479 copying lm_eval/tasks/longbench2/agent_history.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,481 copying lm_eval/tasks/longbench2/dialogue_history.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,483 copying lm_eval/tasks/longbench2/fin_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,484 copying lm_eval/tasks/longbench2/graph.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,487 copying lm_eval/tasks/longbench2/longbench2_code.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,489 copying lm_eval/tasks/longbench2/academic_single.yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:13,491 copying lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:13,493 copying lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:13,495 copying lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:13,497 copying lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:13,499 copying lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:13,501 copying lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/lib/lm_eval/tasks/qa4mre 2026-02-14T10:25:13,503 copying lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/lib/lm_eval/tasks/qa4mre 2026-02-14T10:25:13,505 copying lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/lib/lm_eval/tasks/qa4mre 2026-02-14T10:25:13,507 copying lm_eval/tasks/webqs/webqs.yaml -> build/lib/lm_eval/tasks/webqs 2026-02-14T10:25:13,510 creating build/lib/lm_eval/tasks/alghafa/copa_ar 2026-02-14T10:25:13,512 copying lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/copa_ar 2026-02-14T10:25:13,514 creating build/lib/lm_eval/tasks/alghafa/piqa_ar 2026-02-14T10:25:13,515 copying lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/piqa_ar 2026-02-14T10:25:13,517 copying lm_eval/tasks/meqsum/meqsum.yaml -> build/lib/lm_eval/tasks/meqsum 2026-02-14T10:25:13,519 copying lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,521 copying lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,523 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,525 copying lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,528 copying lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,530 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,532 copying lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,533 copying lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,536 copying lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,538 copying lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,539 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,542 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,544 copying lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,547 copying lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,549 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,551 copying lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,553 copying lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,555 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,557 copying lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,559 copying lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,561 copying lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,563 copying lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,565 copying lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,568 copying lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,570 copying lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,572 copying lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,574 copying lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,576 copying lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,578 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,580 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,582 copying lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,584 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,586 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,589 copying lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,592 copying lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,594 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,596 copying lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,598 copying lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,600 copying lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,602 copying lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,604 copying lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,606 copying lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,608 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,610 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,612 copying lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,614 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,616 copying lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,618 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,620 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,622 copying lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,625 copying lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,627 copying lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,629 copying lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,631 copying lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,633 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,635 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,637 copying lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,640 copying lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:13,642 copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,644 copying lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,646 copying lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,648 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,650 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,652 copying lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,654 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,656 copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,658 copying lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,660 copying lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,662 copying lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,664 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,666 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,669 copying lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,671 copying lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,673 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,675 copying lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,677 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,679 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,681 copying lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,683 copying lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,685 copying lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,688 copying lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,690 copying lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,692 copying lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,694 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,697 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,699 copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,701 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,703 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,705 copying lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,707 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,710 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,712 copying lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,714 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,716 copying lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,718 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,720 copying lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,722 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,724 copying lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,726 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,728 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,730 copying lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,732 copying lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,734 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,737 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,739 copying lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,741 copying lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,743 copying lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,745 copying lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,747 copying lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,749 copying lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,751 copying lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,753 copying lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,755 copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,757 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,759 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,761 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:13,763 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,765 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,767 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,769 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,771 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,773 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,775 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,777 copying lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,779 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,781 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,783 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,785 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,787 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,790 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,792 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,794 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,796 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,798 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,800 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,802 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,804 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,807 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,809 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,811 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,813 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,815 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,817 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,818 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,820 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,822 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,824 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,826 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,828 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,830 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,832 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,834 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,836 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,839 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,841 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,842 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,844 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,846 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,848 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,850 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,852 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,854 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,857 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,859 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,861 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,863 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,864 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,866 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,868 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,870 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,872 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,875 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,877 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,879 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:13,881 copying lm_eval/tasks/glianorex/glianorex.yaml -> build/lib/lm_eval/tasks/glianorex 2026-02-14T10:25:13,883 copying lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/lib/lm_eval/tasks/glianorex 2026-02-14T10:25:13,885 copying lm_eval/tasks/glianorex/glianorex_en.yaml -> build/lib/lm_eval/tasks/glianorex 2026-02-14T10:25:13,887 copying lm_eval/tasks/hellaswag/hellaswag.yaml -> build/lib/lm_eval/tasks/hellaswag 2026-02-14T10:25:13,889 creating build/lib/lm_eval/tasks/gsm8k 2026-02-14T10:25:13,890 copying lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-02-14T10:25:13,892 copying lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-02-14T10:25:13,894 copying lm_eval/tasks/gsm8k/gsm8k.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-02-14T10:25:13,896 copying lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-02-14T10:25:13,899 copying lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-02-14T10:25:13,901 creating build/lib/lm_eval/tasks/swag 2026-02-14T10:25:13,902 copying lm_eval/tasks/swag/swag.yaml -> build/lib/lm_eval/tasks/swag 2026-02-14T10:25:13,905 copying lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:25:13,908 copying lm_eval/tasks/spanish_bench/cocoteros_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:25:13,911 copying lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:25:13,914 copying lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:25:13,917 copying lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:25:13,920 copying lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:25:13,923 copying lm_eval/tasks/spanish_bench/escola.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:25:13,925 copying lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:25:13,927 copying lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:25:13,929 copying lm_eval/tasks/spanish_bench/copa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:25:13,931 creating build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-02-14T10:25:13,932 copying lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-02-14T10:25:13,934 copying lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-02-14T10:25:13,936 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,938 copying lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,940 copying lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,942 copying lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,944 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,946 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,948 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,950 copying lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,952 copying lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,954 copying lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,956 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,958 copying lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,961 copying lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,963 copying lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,965 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,967 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,969 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:13,971 copying lm_eval/tasks/egymmlu/egymmlu_civics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,973 copying lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,975 copying lm_eval/tasks/egymmlu/egymmlu_sociology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,977 copying lm_eval/tasks/egymmlu/egymmlu_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,979 copying lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,981 copying lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,983 copying lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,986 copying lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,988 copying lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,990 copying lm_eval/tasks/egymmlu/egymmlu_management.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,992 copying lm_eval/tasks/egymmlu/egymmlu_social_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,993 copying lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,995 copying lm_eval/tasks/egymmlu/egymmlu_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,997 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:13,999 copying lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,001 copying lm_eval/tasks/egymmlu/egymmlu_accounting.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,003 copying lm_eval/tasks/egymmlu/egymmlu_physics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,005 copying lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,007 copying lm_eval/tasks/egymmlu/egymmlu_geography.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,009 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,011 copying lm_eval/tasks/egymmlu/_egymmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,013 copying lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,016 copying lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,018 copying lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,020 copying lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,022 copying lm_eval/tasks/egymmlu/egymmlu_political_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,024 copying lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,026 copying lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,028 copying lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,030 copying lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,032 copying lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,033 copying lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,036 copying lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,038 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,040 copying lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,044 copying lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,257 copying lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,259 copying lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,262 copying lm_eval/tasks/egymmlu/egymmlu_international_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,264 copying lm_eval/tasks/egymmlu/egymmlu_economics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,266 copying lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,268 copying lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,270 copying lm_eval/tasks/egymmlu/egymmlu_math.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,272 copying lm_eval/tasks/egymmlu/egymmlu_biology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,274 copying lm_eval/tasks/egymmlu/egymmlu_marketing.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,276 copying lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,278 copying lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:14,280 copying lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-02-14T10:25:14,282 copying lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-02-14T10:25:14,283 creating build/lib/lm_eval/tasks/headqa 2026-02-14T10:25:14,284 copying lm_eval/tasks/headqa/headqa_es.yaml -> build/lib/lm_eval/tasks/headqa 2026-02-14T10:25:14,286 copying lm_eval/tasks/headqa/headqa_en.yaml -> build/lib/lm_eval/tasks/headqa 2026-02-14T10:25:14,288 creating build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,290 copying lm_eval/tasks/kmmlu/default/kmmlu_law.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,292 copying lm_eval/tasks/kmmlu/default/kmmlu_health.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,294 copying lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,296 copying lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,298 copying lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,300 copying lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,302 copying lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,304 copying lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,306 copying lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,308 copying lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,310 copying lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,312 copying lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,314 copying lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,317 copying lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,319 copying lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,321 copying lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,323 copying lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,325 copying lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,327 copying lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,329 copying lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,331 copying lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,333 copying lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,336 copying lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,338 copying lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,340 copying lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,342 copying lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,344 copying lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,346 copying lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,347 copying lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,349 copying lm_eval/tasks/kmmlu/default/kmmlu_education.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,351 copying lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,353 copying lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,355 copying lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,357 copying lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,359 copying lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,361 copying lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,363 copying lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,366 copying lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,368 copying lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,370 copying lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,372 copying lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,374 copying lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,376 copying lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,378 copying lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,380 copying lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,382 copying lm_eval/tasks/kmmlu/default/kmmlu_math.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,384 copying lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,386 copying lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,388 copying lm_eval/tasks/kmmlu/default/kmmlu_management.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,390 copying lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:14,392 creating build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,393 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,396 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,399 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,402 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,404 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,406 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,408 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,410 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,412 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,414 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,416 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,418 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,420 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,422 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,424 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,426 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,428 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,430 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,432 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,434 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,436 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,438 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,440 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,442 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,444 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,446 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,448 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,450 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,452 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,454 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,456 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,458 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,460 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,462 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,465 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,466 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,468 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,470 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,472 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,474 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,476 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,478 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,480 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,482 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,484 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,486 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,488 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,490 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,492 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,494 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:14,496 creating build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,497 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,499 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,501 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,503 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,505 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,507 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,509 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,511 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,513 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,515 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,518 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,520 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,522 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,524 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,526 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,528 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,530 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,532 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,534 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,536 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,538 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,540 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,542 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,544 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,546 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,548 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,550 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,552 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,554 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,556 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,558 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,561 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,563 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,565 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,567 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,569 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,571 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,573 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,575 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,577 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,579 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,581 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,583 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,585 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,587 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,590 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,592 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,594 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,597 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,599 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:14,602 creating build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,603 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,606 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,609 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,613 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,617 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,620 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,623 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,627 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,630 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,634 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,637 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,641 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,644 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,647 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,650 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,653 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,657 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,660 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,663 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,665 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,668 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,671 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,674 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,678 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,681 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,684 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,688 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,690 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,693 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,696 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,698 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,701 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,703 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,706 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,710 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,714 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,717 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,719 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,722 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,724 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,727 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,729 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,732 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,735 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,738 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,741 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,743 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,746 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,748 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,751 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:14,755 creating build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,756 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,758 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,760 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,762 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,764 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,766 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,768 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,770 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,772 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,774 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,776 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,778 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,780 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,783 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,785 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,787 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,790 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,792 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,794 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,796 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,798 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,801 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,803 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,805 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,807 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,809 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,811 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,813 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,815 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,817 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,819 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,821 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,823 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,825 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,827 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,829 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,831 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,833 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,835 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,837 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,839 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,841 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,843 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,845 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,847 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,849 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,851 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,853 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,855 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,857 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:14,860 creating build/lib/lm_eval/tasks/openbookqa 2026-02-14T10:25:14,861 copying lm_eval/tasks/openbookqa/openbookqa.yaml -> build/lib/lm_eval/tasks/openbookqa 2026-02-14T10:25:14,863 copying lm_eval/tasks/xquad/xquad_vi.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,865 copying lm_eval/tasks/xquad/xquad_zh.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,867 copying lm_eval/tasks/xquad/xquad_hi.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,869 copying lm_eval/tasks/xquad/xquad_el.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,871 copying lm_eval/tasks/xquad/xquad_ar.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,873 copying lm_eval/tasks/xquad/xquad_de.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,875 copying lm_eval/tasks/xquad/xquad_th.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,877 copying lm_eval/tasks/xquad/xquad_es.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,879 copying lm_eval/tasks/xquad/xquad_en.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,881 copying lm_eval/tasks/xquad/xquad_ru.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,883 copying lm_eval/tasks/xquad/xquad_ro.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,884 copying lm_eval/tasks/xquad/xquad_tr.yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:14,886 creating build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,887 copying lm_eval/tasks/zhoblimp/topicalization_OSV.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,889 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,891 copying lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,893 copying lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,895 copying lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,897 copying lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,899 copying lm_eval/tasks/zhoblimp/left_adverbial_d.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,901 copying lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,903 copying lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,905 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,907 copying lm_eval/tasks/zhoblimp/BEI_preposition.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,909 copying lm_eval/tasks/zhoblimp/ellipsis_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,911 copying lm_eval/tasks/zhoblimp/preposition_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,913 copying lm_eval/tasks/zhoblimp/relative_operator_who.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,915 copying lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,917 copying lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,919 copying lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,921 copying lm_eval/tasks/zhoblimp/causative_shi_ba.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,923 copying lm_eval/tasks/zhoblimp/zhoblimp_group.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,925 copying lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,927 copying lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,929 copying lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,931 copying lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,933 copying lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,936 copying lm_eval/tasks/zhoblimp/left_adverbial_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,938 copying lm_eval/tasks/zhoblimp/principle_A_domain.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,940 copying lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,942 copying lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,945 copying lm_eval/tasks/zhoblimp/passive_body_part.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,947 copying lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,949 copying lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,951 copying lm_eval/tasks/zhoblimp/agent_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,953 copying lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,954 copying lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,956 copying lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,958 copying lm_eval/tasks/zhoblimp/BA_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,960 copying lm_eval/tasks/zhoblimp/principle_A_c_command.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,962 copying lm_eval/tasks/zhoblimp/verb_negation_particle.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,964 copying lm_eval/tasks/zhoblimp/nominal_definite_men.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,966 copying lm_eval/tasks/zhoblimp/PN_numP_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,968 copying lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,970 copying lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,972 copying lm_eval/tasks/zhoblimp/BEI_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,974 copying lm_eval/tasks/zhoblimp/passive_intransitive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,976 copying lm_eval/tasks/zhoblimp/question_A_not_A.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,978 copying lm_eval/tasks/zhoblimp/BA_meiba.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,980 copying lm_eval/tasks/zhoblimp/ya_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,982 copying lm_eval/tasks/zhoblimp/BEI_construction_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,984 copying lm_eval/tasks/zhoblimp/passive_suo.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,986 copying lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,988 copying lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,990 copying lm_eval/tasks/zhoblimp/BA_no_progressive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,992 copying lm_eval/tasks/zhoblimp/BEI_construction_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,994 copying lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,996 copying lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:14,998 copying lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,000 copying lm_eval/tasks/zhoblimp/right_yijing_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,003 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,005 copying lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,007 copying lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,009 copying lm_eval/tasks/zhoblimp/question_daodi_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,012 copying lm_eval/tasks/zhoblimp/question_nandao_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,014 copying lm_eval/tasks/zhoblimp/modal_raising_hui.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,016 copying lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,019 copying lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,021 copying lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,023 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,025 copying lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,027 copying lm_eval/tasks/zhoblimp/agent_causative.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,029 copying lm_eval/tasks/zhoblimp/BA_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,031 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,032 copying lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,035 copying lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,037 copying lm_eval/tasks/zhoblimp/PN_numP_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,039 copying lm_eval/tasks/zhoblimp/preposition_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,041 copying lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,043 copying lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,045 copying lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,047 copying lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,049 copying lm_eval/tasks/zhoblimp/passive_no_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,052 copying lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,055 copying lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,057 copying lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,059 copying lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,061 copying lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,063 copying lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,066 copying lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,068 copying lm_eval/tasks/zhoblimp/left_dou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,070 copying lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,072 copying lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,074 copying lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,076 copying lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,078 copying lm_eval/tasks/zhoblimp/question_particle_nandao.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,080 copying lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,082 copying lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,084 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,086 copying lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,089 copying lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,091 copying lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,095 copying lm_eval/tasks/zhoblimp/topicalization_SOV.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,097 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,099 copying lm_eval/tasks/zhoblimp/right_yijing_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,101 copying lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,103 copying lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,105 copying lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,107 copying lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,109 copying lm_eval/tasks/zhoblimp/you_yige.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,111 copying lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,113 copying lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,115 copying lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,117 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,119 copying lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,121 copying lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,123 copying lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,125 copying lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,127 copying lm_eval/tasks/zhoblimp/left_adverbial_e.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,129 copying lm_eval/tasks/zhoblimp/BA_inversion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,131 copying lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,133 copying lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:15,136 copying lm_eval/tasks/swde/swde.yaml -> build/lib/lm_eval/tasks/swde 2026-02-14T10:25:15,139 copying lm_eval/tasks/mts_dialog/mts_dialog.yaml -> build/lib/lm_eval/tasks/mts_dialog 2026-02-14T10:25:15,142 copying lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml -> build/lib/lm_eval/tasks/mts_dialog 2026-02-14T10:25:15,144 creating build/lib/lm_eval/tasks/gsm_plus 2026-02-14T10:25:15,145 copying lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/lib/lm_eval/tasks/gsm_plus 2026-02-14T10:25:15,147 copying lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/lib/lm_eval/tasks/gsm_plus 2026-02-14T10:25:15,149 creating build/lib/lm_eval/tasks/ulqa 2026-02-14T10:25:15,150 copying lm_eval/tasks/ulqa/celep2.yaml -> build/lib/lm_eval/tasks/ulqa 2026-02-14T10:25:15,152 copying lm_eval/tasks/ulqa/lambada_uyghur.yaml -> build/lib/lm_eval/tasks/ulqa 2026-02-14T10:25:15,155 copying lm_eval/tasks/ulqa/celep1.yaml -> build/lib/lm_eval/tasks/ulqa 2026-02-14T10:25:15,157 copying lm_eval/tasks/ulqa/ulqa.yaml -> build/lib/lm_eval/tasks/ulqa 2026-02-14T10:25:15,159 copying lm_eval/tasks/ulqa/uleval.yaml -> build/lib/lm_eval/tasks/ulqa 2026-02-14T10:25:15,161 copying lm_eval/tasks/ulqa/ulqa_.yaml -> build/lib/lm_eval/tasks/ulqa 2026-02-14T10:25:15,164 creating build/lib/lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:15,165 copying lm_eval/tasks/ulqa/ulut/ulut.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:15,169 copying lm_eval/tasks/ulqa/ulut/wub.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:15,174 copying lm_eval/tasks/ulqa/ulut/nug.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:15,178 copying lm_eval/tasks/ulqa/ulut/wag.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:15,182 copying lm_eval/tasks/ulqa/ulut/wum.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:15,184 copying lm_eval/tasks/ulqa/ulut/wsm.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:15,187 creating build/lib/lm_eval/tasks/xnli_eu 2026-02-14T10:25:15,188 copying lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-02-14T10:25:15,191 copying lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-02-14T10:25:15,192 copying lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-02-14T10:25:15,194 copying lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/lib/lm_eval/tasks/translation 2026-02-14T10:25:15,196 copying lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/lib/lm_eval/tasks/translation 2026-02-14T10:25:15,198 copying lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/lib/lm_eval/tasks/translation 2026-02-14T10:25:15,200 copying lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/lib/lm_eval/tasks/translation 2026-02-14T10:25:15,202 copying lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/lib/lm_eval/tasks/translation 2026-02-14T10:25:15,204 copying lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/lib/lm_eval/tasks/translation 2026-02-14T10:25:15,206 copying lm_eval/tasks/translation/wmt16_en-de.yaml -> build/lib/lm_eval/tasks/translation 2026-02-14T10:25:15,209 copying lm_eval/tasks/translation/wmt16_de-en.yaml -> build/lib/lm_eval/tasks/translation 2026-02-14T10:25:15,211 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light 2026-02-14T10:25:15,213 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-02-14T10:25:15,215 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-02-14T10:25:15,436 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-02-14T10:25:15,440 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-02-14T10:25:15,444 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,447 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,449 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,452 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,455 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,457 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,460 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,462 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,465 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,468 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,470 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,473 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,475 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,478 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,481 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,484 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,488 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,492 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,496 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,717 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,721 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,724 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,728 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,732 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,736 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,739 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,743 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,747 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,751 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,754 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,758 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,762 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,766 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,769 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,774 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,777 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,781 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,785 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,789 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,793 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,797 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:15,802 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,016 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,018 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,021 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,024 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,026 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,028 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,030 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,032 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,034 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,036 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,038 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,040 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,042 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,044 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,046 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,048 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:16,049 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-02-14T10:25:16,051 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-02-14T10:25:16,053 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-02-14T10:25:16,055 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-02-14T10:25:16,057 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-02-14T10:25:16,059 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-02-14T10:25:16,062 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:16,064 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:16,066 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:16,068 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:16,070 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:16,072 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:16,074 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:16,076 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:16,078 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:16,080 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:25:16,082 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-02-14T10:25:16,084 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-02-14T10:25:16,086 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-02-14T10:25:16,088 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-02-14T10:25:16,091 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-02-14T10:25:16,093 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-02-14T10:25:16,095 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-02-14T10:25:16,097 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-02-14T10:25:16,099 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,101 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,104 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,106 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,327 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,329 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,331 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,333 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,335 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,337 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,339 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,341 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,343 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,346 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,348 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,351 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,353 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,355 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,357 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,359 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,363 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,366 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,369 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,374 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,379 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,384 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,598 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,601 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,604 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,608 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,611 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,614 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,617 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,620 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,624 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,627 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,630 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,633 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,636 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,640 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,642 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,645 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,648 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,651 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,654 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,657 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,660 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,663 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,666 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,669 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,672 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,675 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,678 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,681 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,684 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,687 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,690 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,693 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,696 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:25:16,699 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-02-14T10:25:16,702 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-02-14T10:25:16,704 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-02-14T10:25:16,707 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-02-14T10:25:16,710 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-02-14T10:25:16,713 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-02-14T10:25:16,716 copying lm_eval/tasks/race/race.yaml -> build/lib/lm_eval/tasks/race 2026-02-14T10:25:16,719 copying lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,722 copying lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,725 copying lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,728 copying lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,731 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,734 copying lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,737 copying lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,739 copying lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,741 copying lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,743 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,746 copying lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,748 copying lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,750 copying lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,752 copying lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,754 copying lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,756 copying lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,758 copying lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,760 copying lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,762 copying lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,764 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,766 copying lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,767 copying lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,769 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,771 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,773 copying lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,775 copying lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,777 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,779 copying lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:16,781 copying lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,783 copying lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,786 copying lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,788 copying lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,790 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,792 copying lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,794 copying lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,796 copying lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,798 copying lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,800 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,802 copying lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,804 copying lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,806 copying lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,808 copying lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,810 copying lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,812 copying lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,814 copying lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,816 copying lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,818 copying lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,820 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,822 copying lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,824 copying lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,826 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,828 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,830 copying lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,832 copying lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,834 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,836 copying lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:16,838 creating build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,839 copying lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,841 copying lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,843 copying lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,846 copying lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,848 copying lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,850 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,852 copying lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,855 copying lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,857 copying lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,860 copying lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,862 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,864 copying lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,866 copying lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,869 copying lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,871 copying lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,873 copying lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,877 copying lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,880 copying lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,882 copying lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,885 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,887 copying lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,889 copying lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,891 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,893 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,895 copying lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,897 copying lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,899 copying lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,901 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,903 copying lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:16,906 creating build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,906 copying lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,909 copying lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,911 copying lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,913 copying lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,915 copying lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,917 copying lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,920 copying lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,923 copying lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,957 copying lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,959 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,961 copying lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,963 copying lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,965 copying lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,968 copying lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,970 copying lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,972 copying lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,974 copying lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,976 copying lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,978 copying lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,980 copying lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,982 copying lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,984 copying lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,986 copying lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,988 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,990 copying lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,992 copying lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,994 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,997 copying lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:16,999 copying lm_eval/tasks/leaderboard/leaderboard.yaml -> build/lib/lm_eval/tasks/leaderboard 2026-02-14T10:25:17,001 creating build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,002 copying lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,004 copying lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,006 copying lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,009 copying lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,011 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,013 copying lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,015 copying lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,017 copying lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,019 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,021 copying lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,023 copying lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,025 copying lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,027 copying lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,029 copying lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,031 copying lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,034 copying lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,036 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,038 copying lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,040 copying lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,042 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,044 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,047 copying lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,049 copying lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,051 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,053 copying lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:17,055 copying lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2026-02-14T10:25:17,057 copying lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:25:17,059 copying lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:25:17,061 copying lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:25:17,063 copying lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:25:17,064 copying lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-02-14T10:25:17,067 copying lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-02-14T10:25:17,069 copying lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-02-14T10:25:17,071 copying lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-02-14T10:25:17,073 copying lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-02-14T10:25:17,075 copying lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-02-14T10:25:17,077 copying lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-02-14T10:25:17,078 copying lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-02-14T10:25:17,081 copying lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:25:17,083 copying lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:25:17,085 copying lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-02-14T10:25:17,087 copying lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-02-14T10:25:17,089 copying lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-02-14T10:25:17,091 copying lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-02-14T10:25:17,093 copying lm_eval/tasks/mutual/multual_plus.yaml -> build/lib/lm_eval/tasks/mutual 2026-02-14T10:25:17,095 copying lm_eval/tasks/mutual/mutual.yaml -> build/lib/lm_eval/tasks/mutual 2026-02-14T10:25:17,097 copying lm_eval/tasks/e2lmc/noor/noor_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,099 copying lm_eval/tasks/e2lmc/noor/noor_electrical_engineering.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,101 copying lm_eval/tasks/e2lmc/noor/noor_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,103 copying lm_eval/tasks/e2lmc/noor/_noor.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,106 copying lm_eval/tasks/e2lmc/noor/noor_conceptual_physics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,108 copying lm_eval/tasks/e2lmc/noor/noor_high_school_physics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,110 copying lm_eval/tasks/e2lmc/noor/noor_high_school_statistics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,112 copying lm_eval/tasks/e2lmc/noor/_noor_stem.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,114 copying lm_eval/tasks/e2lmc/noor/noor_college_computer_science.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,116 copying lm_eval/tasks/e2lmc/noor/noor_abstract_algebra.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,118 copying lm_eval/tasks/e2lmc/noor/noor_machine_learning.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,120 copying lm_eval/tasks/e2lmc/noor/noor_college_mathematics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,122 copying lm_eval/tasks/e2lmc/noor/noor_college_physics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,124 copying lm_eval/tasks/e2lmc/noor/noor_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:17,126 creating build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:25:17,127 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Chemistry.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:25:17,129 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Biology.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:25:17,131 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Physics.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:25:17,133 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/_sciknoweval_mcqa.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:25:17,135 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Material.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:25:17,137 copying lm_eval/tasks/e2lmc/mmlu_early_training/mmlu_early_training.yaml -> build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-02-14T10:25:17,139 copying lm_eval/tasks/eq_bench/default.yaml -> build/lib/lm_eval/tasks/eq_bench 2026-02-14T10:25:17,141 copying lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml -> build/lib/lm_eval/tasks/eq_bench/multilingual 2026-02-14T10:25:17,143 copying lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml -> build/lib/lm_eval/tasks/eq_bench/multilingual 2026-02-14T10:25:17,145 creating build/lib/lm_eval/tasks/haerae 2026-02-14T10:25:17,146 copying lm_eval/tasks/haerae/haerae_hi.yaml -> build/lib/lm_eval/tasks/haerae 2026-02-14T10:25:17,148 copying lm_eval/tasks/haerae/haerae_lw.yaml -> build/lib/lm_eval/tasks/haerae 2026-02-14T10:25:17,150 copying lm_eval/tasks/haerae/haerae_gk.yaml -> build/lib/lm_eval/tasks/haerae 2026-02-14T10:25:17,152 copying lm_eval/tasks/haerae/_haerae.yaml -> build/lib/lm_eval/tasks/haerae 2026-02-14T10:25:17,154 copying lm_eval/tasks/haerae/haerae_rw.yaml -> build/lib/lm_eval/tasks/haerae 2026-02-14T10:25:17,156 copying lm_eval/tasks/haerae/haerae_sn.yaml -> build/lib/lm_eval/tasks/haerae 2026-02-14T10:25:17,158 copying lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,161 copying lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,163 copying lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,165 copying lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,167 copying lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,169 copying lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,171 copying lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,173 copying lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,175 copying lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,177 copying lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,179 copying lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,181 copying lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,183 copying lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,185 copying lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,187 copying lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,189 copying lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,191 copying lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,193 copying lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,195 copying lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,197 copying lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,199 copying lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,201 copying lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:17,203 creating build/lib/lm_eval/tasks/eus_proficiency 2026-02-14T10:25:17,204 copying lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/lib/lm_eval/tasks/eus_proficiency 2026-02-14T10:25:17,207 copying lm_eval/tasks/qasper/bool.yaml -> build/lib/lm_eval/tasks/qasper 2026-02-14T10:25:17,209 copying lm_eval/tasks/qasper/freeform.yaml -> build/lib/lm_eval/tasks/qasper 2026-02-14T10:25:17,211 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,213 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,215 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,217 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,219 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,221 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,223 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,225 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,227 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,229 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,231 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,233 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,235 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,237 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,240 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,242 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,243 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,246 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,248 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,250 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,251 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,253 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,256 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,257 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,259 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,261 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,263 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,266 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,268 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,270 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,272 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,274 copying lm_eval/tasks/evalita_llm/_evalita-mp.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,276 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,278 copying lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,280 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,282 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,284 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,286 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,288 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,290 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,292 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,294 copying lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,296 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,298 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,300 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,302 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,304 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,306 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,308 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,310 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,312 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,314 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,316 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,318 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,320 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,322 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,324 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,327 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,329 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,331 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,333 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,335 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,337 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,339 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,341 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,343 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,345 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,348 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,350 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,352 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,354 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,356 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,358 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:17,360 copying lm_eval/tasks/score/score_robustness.yaml -> build/lib/lm_eval/tasks/score 2026-02-14T10:25:17,362 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,365 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,367 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,369 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,371 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,373 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,375 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,377 copying lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,379 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,381 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,383 copying lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,385 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,387 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,389 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,391 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,393 copying lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,395 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,397 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,399 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,401 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,403 copying lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,405 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,407 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,409 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,412 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:17,414 copying lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-02-14T10:25:17,416 copying lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-02-14T10:25:17,418 copying lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-02-14T10:25:17,420 copying lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,422 copying lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,424 copying lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,427 copying lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,429 copying lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,432 copying lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,434 copying lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,436 copying lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,438 copying lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,440 copying lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,442 copying lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,444 copying lm_eval/tasks/score/math/score_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,446 copying lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,448 copying lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,450 copying lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,452 copying lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,454 copying lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:17,456 creating build/lib/lm_eval/tasks/bangla 2026-02-14T10:25:17,457 copying lm_eval/tasks/bangla/bangla_mmlu.yaml -> build/lib/lm_eval/tasks/bangla 2026-02-14T10:25:17,459 copying lm_eval/tasks/bangla/bangla_boolqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-02-14T10:25:17,461 copying lm_eval/tasks/bangla/bangla_piqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-02-14T10:25:17,463 copying lm_eval/tasks/bangla/bangla_openbookqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-02-14T10:25:17,465 copying lm_eval/tasks/bangla/bangla_commonsenseqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-02-14T10:25:17,467 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:25:17,469 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:25:17,471 copying lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:25:17,473 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:25:17,475 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:25:17,477 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:25:17,479 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-02-14T10:25:17,481 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-02-14T10:25:17,483 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-02-14T10:25:17,485 copying lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-02-14T10:25:17,487 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-02-14T10:25:17,489 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-02-14T10:25:17,491 copying lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:25:17,493 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:25:17,495 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:25:17,496 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:25:17,498 copying lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2026-02-14T10:25:17,500 copying lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2026-02-14T10:25:17,502 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-02-14T10:25:17,504 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-02-14T10:25:17,506 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-02-14T10:25:17,508 copying lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-02-14T10:25:17,510 copying lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-02-14T10:25:17,512 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-02-14T10:25:17,514 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-02-14T10:25:17,517 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-02-14T10:25:17,519 copying lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-02-14T10:25:17,521 copying lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-02-14T10:25:17,523 copying lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-02-14T10:25:17,525 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-02-14T10:25:17,527 copying lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-02-14T10:25:17,529 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-02-14T10:25:17,531 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-02-14T10:25:17,533 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-02-14T10:25:17,535 copying lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:25:17,537 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:25:17,539 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:25:17,541 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:25:17,543 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-02-14T10:25:17,545 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-02-14T10:25:17,547 copying lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-02-14T10:25:17,549 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-02-14T10:25:17,551 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-02-14T10:25:17,553 copying lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-02-14T10:25:17,555 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-02-14T10:25:17,557 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-02-14T10:25:17,559 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-02-14T10:25:17,561 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-02-14T10:25:17,563 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-02-14T10:25:17,565 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-02-14T10:25:17,567 copying lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-02-14T10:25:17,569 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-02-14T10:25:17,571 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-02-14T10:25:17,574 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-02-14T10:25:17,576 copying lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-02-14T10:25:17,578 copying lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-02-14T10:25:17,580 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-02-14T10:25:17,582 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-02-14T10:25:17,584 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-02-14T10:25:17,586 copying lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-02-14T10:25:17,588 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-02-14T10:25:17,590 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-02-14T10:25:17,592 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-02-14T10:25:17,594 copying lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-02-14T10:25:17,596 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-02-14T10:25:17,598 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-02-14T10:25:17,600 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-02-14T10:25:17,602 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-02-14T10:25:17,604 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-02-14T10:25:17,606 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-02-14T10:25:17,608 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-02-14T10:25:17,610 copying lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-02-14T10:25:17,612 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-02-14T10:25:17,614 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-02-14T10:25:17,616 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:25:17,618 copying lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:25:17,620 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:25:17,622 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:25:17,624 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-02-14T10:25:17,627 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-02-14T10:25:17,629 copying lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-02-14T10:25:17,631 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-02-14T10:25:17,633 copying lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-02-14T10:25:17,635 copying lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-02-14T10:25:17,637 copying lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-02-14T10:25:17,640 copying lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-02-14T10:25:17,642 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-02-14T10:25:17,644 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-02-14T10:25:17,646 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-02-14T10:25:17,648 copying lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-02-14T10:25:17,650 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-02-14T10:25:17,652 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-02-14T10:25:17,654 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-02-14T10:25:17,656 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-02-14T10:25:17,658 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:17,660 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:17,662 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:17,664 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:17,666 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:17,668 copying lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:17,670 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:17,672 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:17,674 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:17,676 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-02-14T10:25:17,678 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-02-14T10:25:17,680 copying lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-02-14T10:25:17,682 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-02-14T10:25:17,684 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-02-14T10:25:17,686 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-02-14T10:25:17,688 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-02-14T10:25:17,690 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-02-14T10:25:17,692 copying lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-02-14T10:25:17,694 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-02-14T10:25:17,696 copying lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-02-14T10:25:17,699 copying lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-02-14T10:25:17,701 copying lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-02-14T10:25:17,703 copying lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-02-14T10:25:17,705 copying lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-02-14T10:25:17,707 copying lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-02-14T10:25:17,709 copying lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-02-14T10:25:17,711 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-02-14T10:25:17,713 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-02-14T10:25:17,715 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-02-14T10:25:17,717 copying lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-02-14T10:25:17,719 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-02-14T10:25:17,722 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-02-14T10:25:17,724 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-02-14T10:25:17,726 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-02-14T10:25:17,728 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-02-14T10:25:17,730 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-02-14T10:25:17,732 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-02-14T10:25:17,734 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-02-14T10:25:17,736 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-02-14T10:25:17,738 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-02-14T10:25:17,740 copying lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-02-14T10:25:17,742 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-02-14T10:25:17,745 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-02-14T10:25:17,747 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-02-14T10:25:17,749 copying lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-02-14T10:25:17,750 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-02-14T10:25:17,752 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-02-14T10:25:17,754 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-02-14T10:25:17,756 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-02-14T10:25:17,758 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-02-14T10:25:17,760 copying lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-02-14T10:25:17,762 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:17,765 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:17,767 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:17,769 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:17,771 copying lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:17,773 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:17,776 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:17,779 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:17,781 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:17,783 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-02-14T10:25:17,785 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-02-14T10:25:17,787 copying lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-02-14T10:25:17,790 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-02-14T10:25:17,792 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-02-14T10:25:17,794 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-02-14T10:25:17,796 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-02-14T10:25:17,799 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:25:17,801 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:25:17,803 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:25:17,805 copying lm_eval/tasks/include/default/North Macedonian/_include_base_44_north macedonian.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:25:17,807 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:25:17,809 copying lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-02-14T10:25:17,811 copying lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-02-14T10:25:17,813 copying lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-02-14T10:25:17,815 copying lm_eval/tasks/include/default/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-02-14T10:25:17,817 copying lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-02-14T10:25:17,819 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-02-14T10:25:17,821 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-02-14T10:25:17,824 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-02-14T10:25:17,826 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-02-14T10:25:17,828 copying lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/default/Basque 2026-02-14T10:25:17,830 copying lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Basque 2026-02-14T10:25:17,832 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-02-14T10:25:17,834 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-02-14T10:25:17,837 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-02-14T10:25:17,839 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-02-14T10:25:17,841 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-02-14T10:25:17,843 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-02-14T10:25:17,846 copying lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-02-14T10:25:17,848 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-02-14T10:25:17,850 copying lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-02-14T10:25:17,852 copying lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-02-14T10:25:17,854 copying lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-02-14T10:25:17,856 copying lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-02-14T10:25:17,858 copying lm_eval/tasks/include/default/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-02-14T10:25:17,860 copying lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-02-14T10:25:17,862 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:17,864 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:17,866 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:17,869 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:17,871 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:17,873 copying lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:17,875 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:17,877 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:17,879 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:17,882 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-02-14T10:25:17,884 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-02-14T10:25:17,886 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-02-14T10:25:17,888 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-02-14T10:25:17,891 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-02-14T10:25:17,893 copying lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-02-14T10:25:17,895 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-02-14T10:25:17,897 copying lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-02-14T10:25:17,900 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-02-14T10:25:17,902 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-02-14T10:25:17,904 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-02-14T10:25:17,906 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-02-14T10:25:17,908 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:25:17,910 copying lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:25:17,913 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:25:17,915 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:25:17,917 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:25:17,919 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:25:17,921 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:25:17,923 copying lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-02-14T10:25:17,926 copying lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-02-14T10:25:17,928 copying lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-02-14T10:25:17,930 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:25:17,932 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:25:17,935 copying lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:25:17,937 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:25:17,939 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:25:17,941 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:25:17,944 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:25:17,946 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:25:17,948 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:25:17,951 copying lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:25:17,953 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:25:17,955 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:25:17,958 copying lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:25:17,960 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:25:17,962 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:25:17,964 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:25:17,966 copying lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-02-14T10:25:17,969 copying lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-02-14T10:25:17,971 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:25:17,973 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:25:17,975 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:25:17,977 copying lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:25:17,979 copying lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:25:17,981 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:25:17,983 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:25:17,985 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:25:17,988 copying lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:25:17,990 copying lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:25:17,992 copying lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:25:17,994 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:25:17,996 copying lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:25:17,998 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:25:18,000 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:25:18,002 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:25:18,005 copying lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:25:18,008 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:25:18,010 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:25:18,012 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:25:18,014 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:25:18,016 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:25:18,018 copying lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:25:18,020 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:25:18,022 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:25:18,024 copying lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:25:18,026 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:25:18,028 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:25:18,031 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:25:18,033 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:25:18,035 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:25:18,037 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:25:18,039 copying lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:25:18,041 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:25:18,043 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:25:18,045 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:25:18,047 copying lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-02-14T10:25:18,049 copying lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-02-14T10:25:18,052 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:25:18,054 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:25:18,056 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:25:18,058 copying lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:25:18,060 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:25:18,063 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:25:18,065 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:25:18,067 copying lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:25:18,069 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:25:18,071 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:25:18,073 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:25:18,075 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:25:18,078 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:25:18,080 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:25:18,082 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:25:18,084 copying lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:25:18,086 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:25:18,089 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:25:18,091 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:25:18,093 copying lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:25:18,095 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:25:18,097 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:25:18,099 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:25:18,101 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:25:18,104 copying lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:25:18,106 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:25:18,108 copying lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:25:18,110 copying lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:25:18,112 copying lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:25:18,114 copying lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:25:18,116 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:25:18,119 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:25:18,121 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:25:18,123 copying lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:25:18,125 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:25:18,127 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:25:18,130 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:25:18,132 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:25:18,134 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:18,137 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:18,139 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:18,141 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:18,144 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:18,146 copying lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:18,148 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:18,151 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:18,154 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:18,157 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:25:18,160 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:25:18,163 copying lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:25:18,166 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:25:18,168 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:25:18,171 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:25:18,174 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:25:18,177 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:25:18,180 copying lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:25:18,182 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:25:18,185 copying lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:25:18,188 copying lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:25:18,191 copying lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:25:18,193 copying lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:25:18,196 copying lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:25:18,199 copying lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:25:18,202 copying lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:25:18,204 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:25:18,207 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:25:18,210 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:25:18,213 copying lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:25:18,216 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:25:18,218 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:25:18,221 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:25:18,224 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:25:18,227 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:25:18,230 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:25:18,233 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:25:18,236 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:25:18,238 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:25:18,241 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:25:18,244 copying lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:25:18,247 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:25:18,249 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:25:18,251 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:25:18,253 copying lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:25:18,256 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:25:18,258 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:25:18,260 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:25:18,262 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:25:18,264 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:25:18,267 copying lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:25:18,269 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:18,271 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:18,273 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:18,276 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:18,278 copying lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:18,280 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:18,282 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:18,284 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:18,287 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:18,289 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:25:18,291 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:25:18,293 copying lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:25:18,295 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:25:18,298 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:25:18,300 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:25:18,302 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:25:18,304 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:25:18,307 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:25:18,309 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:25:18,311 copying lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north macedonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:25:18,313 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:25:18,315 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:25:18,318 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:25:18,320 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:25:18,322 copying lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:25:18,324 copying lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:25:18,327 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:25:18,329 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:25:18,331 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:25:18,333 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:25:18,335 copying lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-02-14T10:25:18,338 copying lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-02-14T10:25:18,340 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:25:18,342 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:25:18,344 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:25:18,346 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:25:18,349 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:25:18,350 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:25:18,353 copying lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:25:18,355 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:25:18,357 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:25:18,359 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:25:18,361 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:25:18,363 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:25:18,365 copying lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:25:18,368 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:25:18,370 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:18,372 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:18,374 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:18,376 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:18,378 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:18,380 copying lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:18,382 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:18,385 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:18,387 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:18,389 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:25:18,392 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:25:18,394 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:25:18,396 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:25:18,398 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:25:18,400 copying lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:25:18,402 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:25:18,404 copying lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:25:18,406 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:25:18,408 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:25:18,410 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:25:18,412 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:25:18,414 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:25:18,416 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:25:18,418 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:25:18,420 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:25:18,422 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:25:18,424 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:25:18,427 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:25:18,429 copying lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:25:18,431 copying lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:25:18,433 copying lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:25:18,435 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:25:18,437 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:25:18,439 copying lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:25:18,441 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:25:18,443 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:25:18,445 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:25:18,447 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:25:18,449 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:25:18,451 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:25:18,454 copying lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:25:18,456 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:25:18,458 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:25:18,460 copying lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:25:18,462 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:25:18,464 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:25:18,466 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:25:18,468 copying lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-02-14T10:25:18,470 copying lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-02-14T10:25:18,472 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:25:18,475 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:25:18,477 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:25:18,479 copying lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:25:18,481 copying lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:25:18,483 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:25:18,486 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:25:18,488 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:25:18,490 copying lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:25:18,492 copying lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:25:18,494 copying lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:25:18,496 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:25:18,498 copying lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:25:18,501 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:25:18,503 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:25:18,505 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:25:18,507 copying lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:25:18,509 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:25:18,511 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:25:18,513 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:25:18,516 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:25:18,518 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:25:18,520 copying lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:25:18,522 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:25:18,524 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:25:18,526 copying lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:25:18,529 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:25:18,531 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:25:18,533 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:25:18,535 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:25:18,537 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:25:18,540 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:25:18,542 copying lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:25:18,544 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:25:18,546 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:25:18,548 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:25:18,550 copying lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-02-14T10:25:18,552 copying lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-02-14T10:25:18,554 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:25:18,556 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:25:18,559 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:25:18,561 copying lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:25:18,563 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:25:18,566 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:25:18,568 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:25:18,570 copying lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:25:18,572 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:25:18,574 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:25:18,577 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:25:18,579 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:25:18,581 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:25:18,583 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:25:18,585 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:25:18,587 copying lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:25:18,590 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:25:18,592 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:25:18,594 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:25:18,596 copying lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:25:18,599 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:25:18,601 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:25:18,603 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:25:18,605 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:25:18,607 copying lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:25:18,609 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:25:18,611 copying lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:25:18,614 copying lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:25:18,616 copying lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:25:18,618 copying lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:25:18,620 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:25:18,622 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:25:18,624 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:25:18,627 copying lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:25:18,629 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:25:18,631 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:25:18,633 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:25:18,635 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:25:18,637 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:18,639 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:18,642 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:18,644 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:18,646 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:18,648 copying lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:18,650 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:18,653 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:18,655 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:18,657 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:25:18,659 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:25:18,661 copying lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:25:18,663 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:25:18,665 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:25:18,668 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:25:18,670 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:25:18,672 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:25:18,674 copying lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:25:18,676 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:25:18,678 copying lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:25:18,680 copying lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:25:18,682 copying lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:25:18,684 copying lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:25:18,687 copying lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:25:18,689 copying lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:25:18,691 copying lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:25:18,694 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:25:18,696 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:25:18,698 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:25:18,700 copying lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:25:18,702 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:25:18,704 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:25:18,707 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:25:18,709 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:25:18,711 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:25:18,713 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:25:18,715 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:25:18,717 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:25:18,719 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:25:18,722 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:25:18,724 copying lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:25:18,726 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:25:18,728 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:25:18,730 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:25:18,733 copying lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:25:18,735 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:25:18,738 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:25:18,740 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:25:18,742 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:25:18,745 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:25:18,747 copying lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:25:18,749 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:18,751 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:18,753 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:18,756 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:18,758 copying lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:18,760 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:18,762 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:18,764 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:18,767 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:18,769 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:25:18,771 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:25:18,774 copying lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:25:18,776 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:25:18,778 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:25:18,780 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:25:18,783 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:25:18,785 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:25:18,787 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:25:18,790 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:25:18,792 copying lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north macedonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:25:18,794 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:25:18,797 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:25:18,799 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:25:18,801 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:25:18,803 copying lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:25:18,806 copying lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:25:18,808 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:25:18,810 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:25:18,812 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:25:18,814 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:25:18,816 copying lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-02-14T10:25:18,819 copying lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-02-14T10:25:18,821 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:25:18,823 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:25:18,825 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:25:18,828 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:25:18,830 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:25:18,832 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:25:18,834 copying lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:25:18,836 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:25:18,838 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:25:18,841 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:25:18,843 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:25:18,845 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:25:18,848 copying lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:25:18,850 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:25:18,852 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:18,854 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:18,857 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:18,859 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:18,861 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:18,863 copying lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:18,866 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:18,868 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:18,870 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:18,872 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:25:18,874 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:25:18,877 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:25:18,879 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:25:18,881 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:25:18,883 copying lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:25:18,886 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:25:18,888 copying lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:25:18,890 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:25:18,893 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:25:18,895 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:25:18,897 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:25:18,899 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:25:18,902 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:25:18,904 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:25:18,906 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:25:18,908 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:25:18,910 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:25:18,913 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:25:18,915 copying lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:25:18,917 copying lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:25:18,919 copying lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:25:18,921 copying lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,923 copying lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,925 copying lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,928 copying lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,930 copying lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,932 copying lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,934 copying lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,936 copying lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,938 copying lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,941 copying lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,943 copying lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,945 copying lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,947 copying lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,949 copying lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,952 copying lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:18,954 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,956 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,958 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,960 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,962 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,964 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,966 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,969 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,971 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,973 copying lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,975 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,977 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,979 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,981 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,983 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:18,986 copying lm_eval/tasks/winogrande/default.yaml -> build/lib/lm_eval/tasks/winogrande 2026-02-14T10:25:18,987 copying lm_eval/tasks/agieval/lsat-ar.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:18,989 copying lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:18,992 copying lm_eval/tasks/agieval/aqua-rat.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:18,994 copying lm_eval/tasks/agieval/gaokao-english.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:18,996 copying lm_eval/tasks/agieval/math.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:18,998 copying lm_eval/tasks/agieval/gaokao-history.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,000 copying lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,002 copying lm_eval/tasks/agieval/sat-math.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,004 copying lm_eval/tasks/agieval/agieval_en.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,006 copying lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,008 copying lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,010 copying lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,012 copying lm_eval/tasks/agieval/gaokao-biology.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,014 copying lm_eval/tasks/agieval/lsat-lr.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,016 copying lm_eval/tasks/agieval/gaokao-geography.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,019 copying lm_eval/tasks/agieval/gaokao-physics.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,021 copying lm_eval/tasks/agieval/agieval.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,023 copying lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,025 copying lm_eval/tasks/agieval/logiqa-zh.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,027 copying lm_eval/tasks/agieval/agieval_cn.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,029 copying lm_eval/tasks/agieval/sat-en.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,031 copying lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,033 copying lm_eval/tasks/agieval/agieval_nous.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,035 copying lm_eval/tasks/agieval/lsat-rc.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,037 copying lm_eval/tasks/agieval/logiqa-en.yaml -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:19,040 copying lm_eval/tasks/arab_culture/_arab_culture.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,042 copying lm_eval/tasks/arab_culture/arab_culture_algeria.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,044 copying lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,046 copying lm_eval/tasks/arab_culture/arab_culture_morocco.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,048 copying lm_eval/tasks/arab_culture/arab_culture_syria.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,050 copying lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,052 copying lm_eval/tasks/arab_culture/arab_culture_sudan.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,054 copying lm_eval/tasks/arab_culture/arab_culture_egypt.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,056 copying lm_eval/tasks/arab_culture/arab_culture_yemen.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,058 copying lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,060 copying lm_eval/tasks/arab_culture/arab_culture_libya.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,062 copying lm_eval/tasks/arab_culture/arab_culture_ksa.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,064 copying lm_eval/tasks/arab_culture/arab_culture_uae.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,066 copying lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,068 copying lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,070 copying lm_eval/tasks/arab_culture/_arab_culture_levant.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,072 copying lm_eval/tasks/arab_culture/arab_culture_jordan.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,074 copying lm_eval/tasks/arab_culture/arab_culture_palestine.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:19,077 copying lm_eval/tasks/humaneval/humaneval_64.yaml -> build/lib/lm_eval/tasks/humaneval 2026-02-14T10:25:19,079 copying lm_eval/tasks/humaneval/humaneval_64_instruct.yaml -> build/lib/lm_eval/tasks/humaneval 2026-02-14T10:25:19,081 copying lm_eval/tasks/humaneval/humaneval_plus.yaml -> build/lib/lm_eval/tasks/humaneval 2026-02-14T10:25:19,083 copying lm_eval/tasks/humaneval/humaneval_instruct.yaml -> build/lib/lm_eval/tasks/humaneval 2026-02-14T10:25:19,085 copying lm_eval/tasks/humaneval/humaneval.yaml -> build/lib/lm_eval/tasks/humaneval 2026-02-14T10:25:19,087 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,089 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,091 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,093 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,096 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,098 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,100 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,102 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,104 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,106 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,108 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,110 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,112 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,114 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,116 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,118 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,120 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,122 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,124 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,126 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,128 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,130 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,132 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,134 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,136 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,138 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,140 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,142 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,145 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,147 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,149 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,151 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,153 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,156 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,158 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,160 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,162 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,164 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,167 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,169 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,171 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,173 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,175 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,177 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,179 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,181 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,183 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,186 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,188 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,190 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,192 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,194 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,196 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,198 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,200 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,202 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,205 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,207 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,209 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,211 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,213 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,215 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:19,217 copying lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,219 copying lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,221 copying lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,223 copying lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,226 copying lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,228 copying lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,230 copying lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,232 copying lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,234 copying lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,236 copying lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,238 copying lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,240 copying lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,243 copying lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,245 copying lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,247 copying lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,249 copying lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,251 copying lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,253 copying lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,255 copying lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,257 copying lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,260 copying lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,262 copying lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,264 copying lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,266 copying lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,269 copying lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,271 copying lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,273 copying lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,275 copying lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,278 copying lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,280 copying lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,282 copying lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:19,284 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,286 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,288 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,290 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,293 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,295 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,297 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,299 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,301 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,303 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,305 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,307 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,309 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,311 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,313 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,315 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,317 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,320 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,322 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,324 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,326 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,328 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,330 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,332 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,334 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,336 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,339 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,341 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,343 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,345 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,347 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,349 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,351 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,353 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:19,355 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,357 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,359 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,361 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,363 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,365 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,367 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,369 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,372 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,374 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,376 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,378 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,380 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,382 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,384 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,386 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,388 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,390 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,392 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,394 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,397 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,399 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,401 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,403 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,404 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,406 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,408 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,410 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,412 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,414 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:19,416 creating build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,418 copying lm_eval/tasks/turblimp/npi_licensing.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,420 copying lm_eval/tasks/turblimp/argument_structure_transitive.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,422 copying lm_eval/tasks/turblimp/quantifiers.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,424 copying lm_eval/tasks/turblimp/passives.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,426 copying lm_eval/tasks/turblimp/binding.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,428 copying lm_eval/tasks/turblimp/determiners.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,430 copying lm_eval/tasks/turblimp/anaphor_agreement.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,432 copying lm_eval/tasks/turblimp/relative_clauses.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,434 copying lm_eval/tasks/turblimp/subject_agreement.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,436 copying lm_eval/tasks/turblimp/scrambling.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,438 copying lm_eval/tasks/turblimp/turblimp_group.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,440 copying lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,442 copying lm_eval/tasks/turblimp/island_effects.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,444 copying lm_eval/tasks/turblimp/nominalization.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,446 copying lm_eval/tasks/turblimp/irregular_forms.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,448 copying lm_eval/tasks/turblimp/suspended_affixation.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,450 copying lm_eval/tasks/turblimp/ellipsis.yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:19,452 copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,454 copying lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,456 copying lm_eval/tasks/blimp/causative.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,458 copying lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,460 copying lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,462 copying lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,465 copying lm_eval/tasks/blimp/_blimp.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,467 copying lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,469 copying lm_eval/tasks/blimp/only_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,471 copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,473 copying lm_eval/tasks/blimp/npi_present_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,475 copying lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,477 copying lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,479 copying lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,481 copying lm_eval/tasks/blimp/complex_NP_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,483 copying lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,485 copying lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,487 copying lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,489 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,491 copying lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,493 copying lm_eval/tasks/blimp/adjunct_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,495 copying lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,497 copying lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,500 copying lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,502 copying lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,504 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,506 copying lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,508 copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,510 copying lm_eval/tasks/blimp/transitive.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,512 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,514 copying lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,516 copying lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,518 copying lm_eval/tasks/blimp/intransitive.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,520 copying lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,523 copying lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,525 copying lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,527 copying lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,529 copying lm_eval/tasks/blimp/inchoative.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,531 copying lm_eval/tasks/blimp/passive_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,533 copying lm_eval/tasks/blimp/npi_present_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,535 copying lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,537 copying lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,539 copying lm_eval/tasks/blimp/passive_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,541 copying lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,543 copying lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,545 copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,547 copying lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,549 copying lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,551 copying lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,553 copying lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,555 copying lm_eval/tasks/blimp/drop_argument.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,557 copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,559 copying lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,561 copying lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,564 copying lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,565 copying lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,567 copying lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,570 copying lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,571 copying lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,574 copying lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,576 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,578 copying lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,580 copying lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,582 copying lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,584 copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,586 copying lm_eval/tasks/blimp/wh_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,589 copying lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,591 copying lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:19,593 creating build/lib/lm_eval/tasks/storycloze 2026-02-14T10:25:19,594 copying lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/lib/lm_eval/tasks/storycloze 2026-02-14T10:25:19,596 copying lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/lib/lm_eval/tasks/storycloze 2026-02-14T10:25:19,598 creating build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,599 copying lm_eval/tasks/multiblimp/multiblimp_bho.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,601 copying lm_eval/tasks/multiblimp/multiblimp_pol.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,604 copying lm_eval/tasks/multiblimp/multiblimp_deu.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,606 copying lm_eval/tasks/multiblimp/multiblimp_nld.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,608 copying lm_eval/tasks/multiblimp/multiblimp_bor.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,610 copying lm_eval/tasks/multiblimp/multiblimp_fas.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,612 copying lm_eval/tasks/multiblimp/multiblimp_spa.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,614 copying lm_eval/tasks/multiblimp/multiblimp_tpn.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,616 copying lm_eval/tasks/multiblimp/multiblimp_ttc.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,618 copying lm_eval/tasks/multiblimp/multiblimp_krl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,620 copying lm_eval/tasks/multiblimp/multiblimp_mkd.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,622 copying lm_eval/tasks/multiblimp/multiblimp_yrl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,624 copying lm_eval/tasks/multiblimp/multiblimp_sme.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,626 copying lm_eval/tasks/multiblimp/multiblimp_egy.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,628 copying lm_eval/tasks/multiblimp/multiblimp_lij.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,630 copying lm_eval/tasks/multiblimp/multiblimp_hye.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,632 copying lm_eval/tasks/multiblimp/multiblimp_hyw.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,634 copying lm_eval/tasks/multiblimp/multiblimp_mar.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,636 copying lm_eval/tasks/multiblimp/multiblimp_ron.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,638 copying lm_eval/tasks/multiblimp/multiblimp_frm.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,640 copying lm_eval/tasks/multiblimp/multiblimp_kxh.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,642 copying lm_eval/tasks/multiblimp/multiblimp_xcl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,644 copying lm_eval/tasks/multiblimp/multiblimp_glg.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,646 copying lm_eval/tasks/multiblimp/multiblimp_myv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,648 copying lm_eval/tasks/multiblimp/multiblimp_por.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,650 copying lm_eval/tasks/multiblimp/multiblimp_wol.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,652 copying lm_eval/tasks/multiblimp/multiblimp_kmr.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,654 copying lm_eval/tasks/multiblimp/multiblimp_kpv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,656 copying lm_eval/tasks/multiblimp/multiblimp_hbo.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,658 copying lm_eval/tasks/multiblimp/multiblimp_sah.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,661 copying lm_eval/tasks/multiblimp/multiblimp_pcm.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,663 copying lm_eval/tasks/multiblimp/multiblimp_cym.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,666 copying lm_eval/tasks/multiblimp/multiblimp_ces.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,669 copying lm_eval/tasks/multiblimp/multiblimp_apu.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,671 copying lm_eval/tasks/multiblimp/multiblimp_sms.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,674 copying lm_eval/tasks/multiblimp/multiblimp_got.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,676 copying lm_eval/tasks/multiblimp/multiblimp_rus.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,679 copying lm_eval/tasks/multiblimp/multiblimp_fao.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,681 copying lm_eval/tasks/multiblimp/multiblimp_hit.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,684 copying lm_eval/tasks/multiblimp/multiblimp_abk.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,687 copying lm_eval/tasks/multiblimp/multiblimp_aqz.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,689 copying lm_eval/tasks/multiblimp/multiblimp_cat.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,692 copying lm_eval/tasks/multiblimp/multiblimp_lav.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,694 copying lm_eval/tasks/multiblimp/multiblimp_slv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,697 copying lm_eval/tasks/multiblimp/multiblimp_bre.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,699 copying lm_eval/tasks/multiblimp/multiblimp_gla.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,702 copying lm_eval/tasks/multiblimp/multiblimp_eus.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,704 copying lm_eval/tasks/multiblimp/multiblimp_kaz.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,707 copying lm_eval/tasks/multiblimp/multiblimp_fra.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,710 copying lm_eval/tasks/multiblimp/multiblimp_kir.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,712 copying lm_eval/tasks/multiblimp/multiblimp_uzb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,715 copying lm_eval/tasks/multiblimp/multiblimp_san.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,717 copying lm_eval/tasks/multiblimp/multiblimp_amh.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,720 copying lm_eval/tasks/multiblimp/multiblimp_isl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,722 copying lm_eval/tasks/multiblimp/multiblimp_bel.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,725 copying lm_eval/tasks/multiblimp/multiblimp_fin.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,727 copying lm_eval/tasks/multiblimp/multiblimp_orv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,730 copying lm_eval/tasks/multiblimp/multiblimp_lat.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,732 copying lm_eval/tasks/multiblimp/multiblimp_dan.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,735 copying lm_eval/tasks/multiblimp/multiblimp_kat.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,737 copying lm_eval/tasks/multiblimp/multiblimp_grc.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,740 copying lm_eval/tasks/multiblimp/multiblimp_urb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,742 copying lm_eval/tasks/multiblimp/multiblimp_tam.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,745 copying lm_eval/tasks/multiblimp/multiblimp_lit.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,747 copying lm_eval/tasks/multiblimp/multiblimp_ita.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,750 copying lm_eval/tasks/multiblimp/multiblimp_bua.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,752 copying lm_eval/tasks/multiblimp/multiblimp_swe.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,755 copying lm_eval/tasks/multiblimp/multiblimp_hbs.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,758 copying lm_eval/tasks/multiblimp/multiblimp_hin.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,760 copying lm_eval/tasks/multiblimp/multiblimp_azz.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,762 copying lm_eval/tasks/multiblimp/multiblimp_wbp.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,764 copying lm_eval/tasks/multiblimp/multiblimp_urd.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,767 copying lm_eval/tasks/multiblimp/multiblimp_heb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,769 copying lm_eval/tasks/multiblimp/multiblimp_ben.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,771 copying lm_eval/tasks/multiblimp/multiblimp_aln.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,773 copying lm_eval/tasks/multiblimp/multiblimp_uig.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,775 copying lm_eval/tasks/multiblimp/multiblimp_quc.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,777 copying lm_eval/tasks/multiblimp/multiblimp_bul.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,779 copying lm_eval/tasks/multiblimp/multiblimp_est.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,781 copying lm_eval/tasks/multiblimp/multiblimp_vep.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,783 copying lm_eval/tasks/multiblimp/multiblimp_koi.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,785 copying lm_eval/tasks/multiblimp/multiblimp_slk.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,787 copying lm_eval/tasks/multiblimp/multiblimp_arb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,789 copying lm_eval/tasks/multiblimp/multiblimp_eng.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,791 copying lm_eval/tasks/multiblimp/multiblimp_guj.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,793 copying lm_eval/tasks/multiblimp/multiblimp_mdf.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,795 copying lm_eval/tasks/multiblimp/multiblimp_ukr.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,797 copying lm_eval/tasks/multiblimp/multiblimp_xpg.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,799 copying lm_eval/tasks/multiblimp/multiblimp_nds.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,801 copying lm_eval/tasks/multiblimp/multiblimp_sqi.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,803 copying lm_eval/tasks/multiblimp/multiblimp_xnr.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,805 copying lm_eval/tasks/multiblimp/multiblimp_chu.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,807 copying lm_eval/tasks/multiblimp/multiblimp_hsb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,809 copying lm_eval/tasks/multiblimp/multiblimp_gle.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,811 copying lm_eval/tasks/multiblimp/multiblimp_fro.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,813 copying lm_eval/tasks/multiblimp/multiblimp_hun.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,815 copying lm_eval/tasks/multiblimp/multiblimp_olo.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,817 copying lm_eval/tasks/multiblimp/multiblimp_nhi.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,819 copying lm_eval/tasks/multiblimp/multiblimp_ell.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,821 copying lm_eval/tasks/multiblimp/multiblimp_ota.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,823 copying lm_eval/tasks/multiblimp/multiblimp_tur.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:19,825 copying lm_eval/tasks/drop/default.yaml -> build/lib/lm_eval/tasks/drop 2026-02-14T10:25:19,827 copying lm_eval/tasks/bbq/bbq_multiple_choice.yaml -> build/lib/lm_eval/tasks/bbq 2026-02-14T10:25:19,829 copying lm_eval/tasks/bbq/bbq_generate_disambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-02-14T10:25:19,831 copying lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-02-14T10:25:19,833 copying lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-02-14T10:25:19,835 copying lm_eval/tasks/bbq/bbq_generate.yaml -> build/lib/lm_eval/tasks/bbq 2026-02-14T10:25:19,837 copying lm_eval/tasks/bbq/bbq_generate_ambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-02-14T10:25:19,839 copying lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,841 copying lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,844 copying lm_eval/tasks/catalan_bench/teca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,846 copying lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,848 copying lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,850 copying lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,852 copying lm_eval/tasks/catalan_bench/cocoteros_va.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,854 copying lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,856 copying lm_eval/tasks/catalan_bench/coqcat.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,858 copying lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,860 copying lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,862 copying lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,864 copying lm_eval/tasks/catalan_bench/xnli_va.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,866 copying lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,868 copying lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,870 copying lm_eval/tasks/catalan_bench/catcola.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,872 copying lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,874 copying lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,876 copying lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,878 copying lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,880 copying lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,882 copying lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,884 copying lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:19,887 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,889 copying lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,891 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,893 copying lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,895 copying lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,897 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,899 copying lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,901 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,903 copying lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,905 copying lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,908 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,910 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,912 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,914 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,917 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,919 copying lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,921 copying lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:19,923 creating build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-02-14T10:25:19,924 copying lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-02-14T10:25:19,926 copying lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-02-14T10:25:19,928 copying lm_eval/tasks/catalan_bench/truthfulqa_va/truthfulqa_va.yaml -> build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-02-14T10:25:19,931 copying lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-02-14T10:25:19,933 copying lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-02-14T10:25:19,935 copying lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-02-14T10:25:19,937 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,939 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,941 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,943 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,945 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,947 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,949 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,951 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,953 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,955 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,957 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,959 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,962 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,964 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,966 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,968 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,970 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:19,972 creating build/lib/lm_eval/tasks/wmdp 2026-02-14T10:25:19,973 copying lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/lib/lm_eval/tasks/wmdp 2026-02-14T10:25:19,975 copying lm_eval/tasks/wmdp/_wmdp.yaml -> build/lib/lm_eval/tasks/wmdp 2026-02-14T10:25:19,977 copying lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/lib/lm_eval/tasks/wmdp 2026-02-14T10:25:19,979 copying lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/lib/lm_eval/tasks/wmdp 2026-02-14T10:25:19,981 copying lm_eval/tasks/graphwalks/graphwalks_1M.yaml -> build/lib/lm_eval/tasks/graphwalks 2026-02-14T10:25:19,983 copying lm_eval/tasks/graphwalks/graphwalks_128k.yaml -> build/lib/lm_eval/tasks/graphwalks 2026-02-14T10:25:19,985 copying lm_eval/tasks/graphwalks/graphwalks.yaml -> build/lib/lm_eval/tasks/graphwalks 2026-02-14T10:25:19,987 creating build/lib/lm_eval/tasks/lambada_multilingual 2026-02-14T10:25:19,988 copying lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-02-14T10:25:19,990 copying lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-02-14T10:25:19,992 copying lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-02-14T10:25:19,994 copying lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-02-14T10:25:19,996 copying lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-02-14T10:25:19,998 copying lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:25:20,000 copying lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:25:20,002 copying lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:25:20,004 copying lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-02-14T10:25:20,007 copying lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-02-14T10:25:20,009 copying lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-02-14T10:25:20,011 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:25:20,013 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:25:20,015 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:25:20,017 copying lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-02-14T10:25:20,020 copying lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-02-14T10:25:20,022 copying lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-02-14T10:25:20,024 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:25:20,026 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:25:20,028 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:25:20,030 creating build/lib/lm_eval/tasks/bear 2026-02-14T10:25:20,031 copying lm_eval/tasks/bear/bear_big.yaml -> build/lib/lm_eval/tasks/bear 2026-02-14T10:25:20,033 copying lm_eval/tasks/bear/bear.yaml -> build/lib/lm_eval/tasks/bear 2026-02-14T10:25:20,035 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,037 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,039 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,041 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,255 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,257 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,259 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,261 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,263 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,265 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,267 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,269 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,271 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,273 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,275 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:20,277 copying lm_eval/tasks/careqa/careqa_open_perplexity.yaml -> build/lib/lm_eval/tasks/careqa 2026-02-14T10:25:20,279 copying lm_eval/tasks/careqa/careqa_es.yaml -> build/lib/lm_eval/tasks/careqa 2026-02-14T10:25:20,281 copying lm_eval/tasks/careqa/careqa_open.yaml -> build/lib/lm_eval/tasks/careqa 2026-02-14T10:25:20,283 copying lm_eval/tasks/careqa/careqa_en.yaml -> build/lib/lm_eval/tasks/careqa 2026-02-14T10:25:20,285 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2026-02-14T10:25:20,287 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,289 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,291 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,293 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,295 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,297 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,299 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,301 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,303 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,305 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,308 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,310 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,312 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,314 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,316 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,317 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,319 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:20,321 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,323 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,326 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,328 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,330 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,332 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,334 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,336 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,338 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,340 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,342 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,344 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,346 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,348 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,350 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,352 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,354 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:20,356 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,358 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,360 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,362 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,364 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,366 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,368 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,370 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,372 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,374 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,376 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,378 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,380 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,382 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,384 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,386 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,388 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:20,390 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,392 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,394 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,396 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,399 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,401 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,403 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,406 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,408 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,410 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,412 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,414 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,416 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,418 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,420 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,422 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,424 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:20,426 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,428 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,429 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,431 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,433 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,436 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,438 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,440 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,442 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,444 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,446 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,448 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,450 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,452 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,455 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,457 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,459 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:20,462 copying lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2026-02-14T10:25:20,464 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,467 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,469 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,472 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,475 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,477 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,480 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,484 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,490 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,494 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,496 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,499 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,502 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,504 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,507 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,509 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,512 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,515 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:20,518 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,520 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,523 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,526 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,529 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,531 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,534 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,537 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,540 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,543 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,546 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,549 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,553 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,556 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,560 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,565 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,570 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,574 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:20,617 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,620 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,623 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,626 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,629 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,632 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,634 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,637 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,639 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,641 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,644 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,647 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,650 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,653 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,655 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,658 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,660 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,662 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:20,665 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,668 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,671 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,673 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,675 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,677 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,679 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,681 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,683 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,686 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,688 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,690 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,692 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,694 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,696 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,699 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,701 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,703 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:20,705 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,707 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,710 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,712 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,714 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,716 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,718 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,720 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,722 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,725 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,727 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,729 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,731 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,733 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,735 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,738 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,740 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,742 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:20,744 copying lm_eval/tasks/galician_bench/galician_bench.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,746 copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,749 copying lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,751 copying lm_eval/tasks/galician_bench/galcola.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,753 copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,755 copying lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,757 copying lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,759 copying lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,761 copying lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,763 copying lm_eval/tasks/galician_bench/paws_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,765 copying lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,767 copying lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,769 copying lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:20,771 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,774 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,776 copying lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,778 copying lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,780 copying lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,783 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,785 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,787 copying lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,789 copying lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,791 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,793 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,796 copying lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,797 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,799 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,802 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,804 copying lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,806 copying lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:20,808 copying lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,810 copying lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,812 copying lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,814 copying lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,816 copying lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,818 copying lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,821 copying lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,822 copying lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,825 copying lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,827 copying lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,829 copying lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,831 copying lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,834 copying lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,837 copying lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,841 copying lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,843 copying lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,845 copying lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,847 copying lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:20,849 creating build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,850 copying lm_eval/tasks/blimp_nl/passive__aci.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,852 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,854 copying lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,857 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,859 copying lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,861 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,863 copying lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,865 copying lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,867 copying lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,869 copying lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,871 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,873 copying lm_eval/tasks/blimp_nl/complementive__intransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,875 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,877 copying lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,879 copying lm_eval/tasks/blimp_nl/relativization__island.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,881 copying lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,883 copying lm_eval/tasks/blimp_nl/complementive__transitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,885 copying lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,887 copying lm_eval/tasks/blimp_nl/blimp_nl_group.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,890 copying lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,892 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,894 copying lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,896 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,898 copying lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,902 copying lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,905 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,909 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,912 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,915 copying lm_eval/tasks/blimp_nl/complementive__position_verb.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,917 copying lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,919 copying lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,921 copying lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,923 copying lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,925 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,927 copying lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,929 copying lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,931 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,933 copying lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,935 copying lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,937 copying lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,939 copying lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,941 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,943 copying lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,945 copying lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,947 copying lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,950 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,952 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,954 copying lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,956 copying lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,958 copying lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,960 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,962 copying lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,964 copying lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,966 copying lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,968 copying lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,970 copying lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,972 copying lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,974 copying lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,977 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,979 copying lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,981 copying lm_eval/tasks/blimp_nl/topicalization__island.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,984 copying lm_eval/tasks/blimp_nl/verb_second__order_main.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,986 copying lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,988 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,990 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,993 copying lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,995 copying lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:20,998 copying lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,000 copying lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,003 copying lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,005 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,007 copying lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,009 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,011 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,013 copying lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,015 copying lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,017 copying lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,019 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,021 copying lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,023 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,025 copying lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,027 copying lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,029 copying lm_eval/tasks/blimp_nl/passive__impersonal.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,031 copying lm_eval/tasks/blimp_nl/r_words__adverbial.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,033 copying lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:21,036 copying lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:25:21,038 copying lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:25:21,040 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:25:21,042 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:25:21,044 copying lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:25:21,046 copying lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:25:21,049 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:25:21,051 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:25:21,053 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:25:21,055 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:25:21,057 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:25:21,059 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:25:21,061 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,063 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,065 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,068 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,070 copying lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,072 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,074 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,076 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,078 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,080 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,082 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,084 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,086 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,088 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,090 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,092 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,094 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,096 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,098 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,101 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,103 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,105 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,107 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,109 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,111 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:21,113 copying lm_eval/tasks/groundcocoa/groundcocoa.yaml -> build/lib/lm_eval/tasks/groundcocoa 2026-02-14T10:25:21,115 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,117 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,119 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,121 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,123 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,125 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,127 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,129 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,131 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,133 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,135 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,137 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,139 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,141 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,143 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,145 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,147 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,149 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,151 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,153 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,155 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:21,157 creating build/lib/lm_eval/tasks/polemo2 2026-02-14T10:25:21,158 copying lm_eval/tasks/polemo2/polemo2_out.yaml -> build/lib/lm_eval/tasks/polemo2 2026-02-14T10:25:21,160 copying lm_eval/tasks/polemo2/polemo2_in.yaml -> build/lib/lm_eval/tasks/polemo2 2026-02-14T10:25:21,162 creating build/lib/lm_eval/tasks/asdiv 2026-02-14T10:25:21,163 copying lm_eval/tasks/asdiv/default.yaml -> build/lib/lm_eval/tasks/asdiv 2026-02-14T10:25:21,165 copying lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/lib/lm_eval/tasks/asdiv 2026-02-14T10:25:21,168 copying lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-02-14T10:25:21,170 copying lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-02-14T10:25:21,172 copying lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-02-14T10:25:21,174 copying lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-02-14T10:25:21,176 copying lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-02-14T10:25:21,178 copying lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-02-14T10:25:21,180 copying lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-02-14T10:25:21,181 copying lm_eval/tasks/mathqa/mathqa.yaml -> build/lib/lm_eval/tasks/mathqa 2026-02-14T10:25:21,183 copying lm_eval/tasks/longbench/repobench-p.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,185 copying lm_eval/tasks/longbench/narrativeqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,187 copying lm_eval/tasks/longbench/musique.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,189 copying lm_eval/tasks/longbench/2wikimqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,191 copying lm_eval/tasks/longbench/_longbench_multi_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,193 copying lm_eval/tasks/longbench/vcsum.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,195 copying lm_eval/tasks/longbench/lsht.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,198 copying lm_eval/tasks/longbench/multifieldqa_zh.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,200 copying lm_eval/tasks/longbench/_longbench_fewshot_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,201 copying lm_eval/tasks/longbench/_longbench.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,203 copying lm_eval/tasks/longbench/_longbench_multi.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,205 copying lm_eval/tasks/longbench/qmsum.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,208 copying lm_eval/tasks/longbench/_longbench_synthetic.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,210 copying lm_eval/tasks/longbench/multifieldqa_en_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,212 copying lm_eval/tasks/longbench/passage_count_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,214 copying lm_eval/tasks/longbench/samsum.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,216 copying lm_eval/tasks/longbench/passage_retrieval_en.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,218 copying lm_eval/tasks/longbench/passage_retrieval_zh.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,220 copying lm_eval/tasks/longbench/multi_news_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,222 copying lm_eval/tasks/longbench/multi_news.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,224 copying lm_eval/tasks/longbench/triviaqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,226 copying lm_eval/tasks/longbench/_longbench_code.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,228 copying lm_eval/tasks/longbench/trec_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,230 copying lm_eval/tasks/longbench/passage_retrieval_en_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,232 copying lm_eval/tasks/longbench/triviaqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,234 copying lm_eval/tasks/longbench/hotpotqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,236 copying lm_eval/tasks/longbench/hotpotqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,238 copying lm_eval/tasks/longbench/multifieldqa_en.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,240 copying lm_eval/tasks/longbench/trec.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,242 copying lm_eval/tasks/longbench/repobench-p_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,244 copying lm_eval/tasks/longbench/_longbench_single_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,247 copying lm_eval/tasks/longbench/qasper.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,249 copying lm_eval/tasks/longbench/gov_report.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,251 copying lm_eval/tasks/longbench/lcc.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,253 copying lm_eval/tasks/longbench/qasper_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,254 copying lm_eval/tasks/longbench/_longbench_fewshot.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,256 copying lm_eval/tasks/longbench/_longbench_single.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,258 copying lm_eval/tasks/longbench/dureader.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,260 copying lm_eval/tasks/longbench/_longbench_synthetic_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,262 copying lm_eval/tasks/longbench/_longbench_summarization.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,264 copying lm_eval/tasks/longbench/samsum_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,266 copying lm_eval/tasks/longbench/2wikimqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,268 copying lm_eval/tasks/longbench/_longbench_code_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,270 copying lm_eval/tasks/longbench/_longbench_summarization_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,272 copying lm_eval/tasks/longbench/gov_report_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,275 copying lm_eval/tasks/longbench/passage_count.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,278 copying lm_eval/tasks/longbench/_longbench_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,281 copying lm_eval/tasks/longbench/lcc_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:21,283 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,286 copying lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,289 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,292 copying lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,294 copying lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,297 copying lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,300 copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,303 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,305 copying lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,308 copying lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,311 copying lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,314 copying lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,317 copying lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,320 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,322 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,325 copying lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,328 copying lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,330 copying lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,333 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,335 copying lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,338 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,341 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,343 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,346 copying lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,349 copying lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,351 copying lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,354 copying lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,357 copying lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,359 copying lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,362 copying lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,365 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,368 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,370 copying lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,373 copying lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,375 copying lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,377 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,379 copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,381 copying lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,383 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,385 copying lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,387 copying lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,389 copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,391 copying lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,394 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,396 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,398 copying lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,400 copying lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,402 copying lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,404 copying lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,406 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,408 copying lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,410 copying lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,412 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,414 copying lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,417 copying lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,419 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,421 copying lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,423 copying lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,425 copying lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,427 copying lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,429 copying lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,431 copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,433 copying lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,435 copying lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,437 copying lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,439 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,441 copying lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,443 copying lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,445 copying lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,447 copying lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,449 copying lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,452 copying lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,454 copying lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,456 copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,458 copying lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,460 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,462 copying lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,465 copying lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,467 copying lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,469 copying lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,471 copying lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,473 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,475 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,477 copying lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,479 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,481 copying lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,483 copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,486 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,488 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,490 copying lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,492 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,494 copying lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,496 copying lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,498 copying lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,500 copying lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,502 copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,504 copying lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,506 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,508 copying lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,510 copying lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,512 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,514 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,517 copying lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,519 copying lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,521 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,523 copying lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,525 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,527 copying lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,529 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,532 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,534 copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,536 copying lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,538 copying lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,540 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,543 copying lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,545 copying lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,547 copying lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,549 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,551 copying lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,553 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,555 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,557 copying lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,559 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,562 copying lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,564 copying lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,566 copying lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,568 copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,570 copying lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,572 copying lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,574 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,577 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,579 copying lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,581 copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,584 copying lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,586 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:21,588 creating build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-02-14T10:25:21,589 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-02-14T10:25:21,591 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-02-14T10:25:21,593 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-02-14T10:25:21,595 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,597 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,599 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,601 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,603 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,605 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,607 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,610 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,612 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,614 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,616 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,618 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,620 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,622 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,625 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,627 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,629 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,631 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,633 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,635 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,638 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,640 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,642 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,644 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,646 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,648 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,650 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,652 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,654 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,657 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,659 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,661 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,663 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,665 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,667 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,669 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,671 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,673 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,676 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,678 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,680 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,682 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,684 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,686 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,688 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,690 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,692 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,694 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,696 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:21,698 copying lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,700 copying lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,702 copying lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,705 copying lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,707 copying lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,709 copying lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,711 copying lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,713 copying lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,715 copying lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,717 copying lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,719 copying lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,721 copying lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,723 copying lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,725 copying lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,727 copying lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,729 copying lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,732 copying lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,734 copying lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,736 copying lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,738 copying lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,740 copying lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,743 copying lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,745 copying lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,747 copying lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,749 copying lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,751 copying lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,753 copying lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,755 copying lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,757 copying lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,759 copying lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,761 copying lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,763 copying lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,765 copying lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,767 copying lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,769 copying lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,771 copying lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,773 copying lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,775 copying lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,778 copying lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,780 copying lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,782 copying lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,784 copying lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,786 copying lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,788 copying lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,790 copying lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,792 copying lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,794 copying lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,796 copying lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,798 copying lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,800 copying lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,802 copying lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,804 copying lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,807 copying lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,809 copying lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,811 copying lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,813 copying lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,815 copying lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,818 copying lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,820 copying lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,822 copying lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,824 copying lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,826 copying lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,828 copying lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,829 copying lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,831 copying lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,833 copying lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,835 copying lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,837 copying lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,840 copying lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,842 copying lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,844 copying lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,846 copying lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,848 copying lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,850 copying lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,852 copying lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,854 copying lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,856 copying lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,858 copying lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,860 copying lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,862 copying lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,864 copying lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,866 copying lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,868 copying lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,870 copying lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,872 copying lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,874 copying lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,876 copying lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,878 copying lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,881 copying lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,883 copying lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,885 copying lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,887 copying lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,889 copying lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,890 copying lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,892 copying lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,894 copying lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,896 copying lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,899 copying lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,901 copying lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,903 copying lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,905 copying lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,907 copying lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,909 copying lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,911 copying lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,913 copying lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,916 copying lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,918 copying lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,920 copying lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,922 copying lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,924 copying lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,926 copying lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,928 copying lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,930 copying lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,932 copying lm_eval/tasks/belebele/_belebele.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,934 copying lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,937 copying lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,939 copying lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,942 copying lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,944 copying lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,946 copying lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,949 copying lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,951 copying lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,953 copying lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:21,955 creating build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:25:21,956 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:25:21,958 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:25:21,960 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:25:21,962 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:25:21,963 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:25:21,966 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:25:21,967 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:25:21,969 creating build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,971 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,973 copying lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,975 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,977 copying lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,980 copying lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,982 copying lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,984 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,986 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,988 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,991 copying lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,993 copying lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,995 copying lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,997 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:21,999 copying lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,001 copying lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,003 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,006 copying lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,008 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,010 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,012 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,014 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,017 copying lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,019 copying lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,021 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,023 copying lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,025 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,027 copying lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,029 copying lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,032 copying lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,034 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,036 copying lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,038 copying lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,040 copying lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,043 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,044 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,047 copying lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,049 copying lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,051 copying lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,053 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,055 copying lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,057 copying lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,059 copying lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,061 copying lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,063 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,066 copying lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,068 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,070 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,073 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,075 copying lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,077 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,079 copying lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,081 copying lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,083 copying lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,086 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,088 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,090 copying lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,092 copying lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,094 copying lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:22,096 copying lm_eval/tasks/olaph/olaph_perplexity.yaml -> build/lib/lm_eval/tasks/olaph 2026-02-14T10:25:22,098 copying lm_eval/tasks/olaph/olaph.yaml -> build/lib/lm_eval/tasks/olaph 2026-02-14T10:25:22,100 copying lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml -> build/lib/lm_eval/tasks/discrim_eval 2026-02-14T10:25:22,102 copying lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml -> build/lib/lm_eval/tasks/discrim_eval 2026-02-14T10:25:22,105 copying lm_eval/tasks/libra/ru_2wikimultihopqa.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,107 copying lm_eval/tasks/libra/ru_qasper.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,109 copying lm_eval/tasks/libra/ru_babilong_qa5.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,111 copying lm_eval/tasks/libra/ru_babilong_qa2.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,113 copying lm_eval/tasks/libra/ru_gsm100.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,115 copying lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,117 copying lm_eval/tasks/libra/ru_babilong_qa1.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,119 copying lm_eval/tasks/libra/passkey_with_librusec.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,121 copying lm_eval/tasks/libra/matreshka_names.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,123 copying lm_eval/tasks/libra/matreshka_yes_no.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,126 copying lm_eval/tasks/libra/_simple_information_retrieval.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,128 copying lm_eval/tasks/libra/librusec_mhqa.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,130 copying lm_eval/tasks/libra/ru_babilong_qa3.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,132 copying lm_eval/tasks/libra/librusec_history.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,135 copying lm_eval/tasks/libra/passkey.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,137 copying lm_eval/tasks/libra/ru_sci_passage_count.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,139 copying lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,141 copying lm_eval/tasks/libra/long_context_multiq.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,143 copying lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,145 copying lm_eval/tasks/libra/ru_babilong_qa4.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,148 copying lm_eval/tasks/libra/_multi_hop_question_answering.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,150 copying lm_eval/tasks/libra/ru_quality.yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:22,152 copying lm_eval/tasks/mmmu/mmmu_history.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,154 copying lm_eval/tasks/mmmu/_art_and_design.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,157 copying lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,158 copying lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,161 copying lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,163 copying lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,165 copying lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,167 copying lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,169 copying lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,171 copying lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,173 copying lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,175 copying lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,177 copying lm_eval/tasks/mmmu/_science.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,179 copying lm_eval/tasks/mmmu/mmmu_music.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,181 copying lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,183 copying lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,185 copying lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,187 copying lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,189 copying lm_eval/tasks/mmmu/mmmu_design.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,191 copying lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,194 copying lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,196 copying lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,198 copying lm_eval/tasks/mmmu/_business.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,200 copying lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,202 copying lm_eval/tasks/mmmu/mmmu_math.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,204 copying lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,207 copying lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,209 copying lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,211 copying lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,213 copying lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,216 copying lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,218 copying lm_eval/tasks/mmmu/mmmu_art.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,220 copying lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,222 copying lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,224 copying lm_eval/tasks/mmmu/_mmmu.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,226 copying lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,229 copying lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:22,231 copying lm_eval/tasks/pisa/_pisa.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,233 copying lm_eval/tasks/pisa/pisa_it.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,235 copying lm_eval/tasks/pisa/pisa_en.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,237 copying lm_eval/tasks/pisa/pisa_en_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,238 copying lm_eval/tasks/pisa/pisa_it_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,240 copying lm_eval/tasks/pisa/pisa_es.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,242 copying lm_eval/tasks/pisa/_pisa_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,244 copying lm_eval/tasks/pisa/pisa_fr_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,246 copying lm_eval/tasks/pisa/pisa_es_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,248 copying lm_eval/tasks/pisa/pisa_de_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,251 copying lm_eval/tasks/pisa/pisa_fr.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,253 copying lm_eval/tasks/pisa/pisa_ch_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,255 copying lm_eval/tasks/pisa/pisa_ch.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,257 copying lm_eval/tasks/pisa/pisa_de.yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:22,259 creating build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,260 copying lm_eval/tasks/mela/mela_ja.yaml -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,262 copying lm_eval/tasks/mela/mela_de.yaml -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,264 copying lm_eval/tasks/mela/mela_ar.yaml -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,266 copying lm_eval/tasks/mela/mela_zh.yaml -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,268 copying lm_eval/tasks/mela/mela_ru.yaml -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,270 copying lm_eval/tasks/mela/mela_es.yaml -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,272 copying lm_eval/tasks/mela/mela_it.yaml -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,274 copying lm_eval/tasks/mela/mela_en.yaml -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,276 copying lm_eval/tasks/mela/mela_is.yaml -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,278 copying lm_eval/tasks/mela/_mela.yaml -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,280 copying lm_eval/tasks/mela/mela_fr.yaml -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:22,283 copying lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/lib/lm_eval/tasks/csatqa 2026-02-14T10:25:22,285 copying lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/lib/lm_eval/tasks/csatqa 2026-02-14T10:25:22,287 copying lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/lib/lm_eval/tasks/csatqa 2026-02-14T10:25:22,289 copying lm_eval/tasks/csatqa/_csatqa.yaml -> build/lib/lm_eval/tasks/csatqa 2026-02-14T10:25:22,291 copying lm_eval/tasks/csatqa/csatqa_li.yaml -> build/lib/lm_eval/tasks/csatqa 2026-02-14T10:25:22,293 copying lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/lib/lm_eval/tasks/csatqa 2026-02-14T10:25:22,295 copying lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/lib/lm_eval/tasks/csatqa 2026-02-14T10:25:22,297 copying lm_eval/tasks/chartqa/chartqa.yaml -> build/lib/lm_eval/tasks/chartqa 2026-02-14T10:25:22,300 copying lm_eval/tasks/chartqa/chartqa_llama.yaml -> build/lib/lm_eval/tasks/chartqa 2026-02-14T10:25:22,302 copying lm_eval/tasks/chartqa/chartqa_llama_90.yaml -> build/lib/lm_eval/tasks/chartqa 2026-02-14T10:25:22,304 copying lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml -> build/lib/lm_eval/tasks/cnn_dailymail 2026-02-14T10:25:22,307 copying lm_eval/tasks/xnli/xnli_th.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,309 copying lm_eval/tasks/xnli/xnli_hi.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,311 copying lm_eval/tasks/xnli/xnli_bg.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,313 copying lm_eval/tasks/xnli/xnli_zh.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,315 copying lm_eval/tasks/xnli/xnli_ur.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,317 copying lm_eval/tasks/xnli/xnli_fr.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,319 copying lm_eval/tasks/xnli/xnli_vi.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,321 copying lm_eval/tasks/xnli/xnli_sw.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,323 copying lm_eval/tasks/xnli/xnli_de.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,326 copying lm_eval/tasks/xnli/_xnli.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,329 copying lm_eval/tasks/xnli/xnli_ru.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,331 copying lm_eval/tasks/xnli/xnli_el.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,333 copying lm_eval/tasks/xnli/xnli_ar.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,335 copying lm_eval/tasks/xnli/xnli_en.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,337 copying lm_eval/tasks/xnli/xnli_es.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,339 copying lm_eval/tasks/xnli/xnli_tr.yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:22,341 creating build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,342 copying lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,345 copying lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,347 copying lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,349 copying lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,351 copying lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,354 copying lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,356 copying lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,358 copying lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,360 copying lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,362 copying lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,365 copying lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,367 copying lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,369 copying lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,371 copying lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,374 copying lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,376 copying lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,378 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,380 copying lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,383 copying lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,385 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,387 copying lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,389 copying lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,391 copying lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,393 copying lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,395 copying lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,398 copying lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,400 copying lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,402 copying lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,404 copying lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,407 copying lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,409 copying lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,411 copying lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,413 copying lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,415 copying lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,417 copying lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,419 copying lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,421 copying lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,424 copying lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,426 copying lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,428 copying lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,430 copying lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,432 copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,435 copying lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,437 copying lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,439 copying lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,441 copying lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,443 copying lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,446 copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,448 copying lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,450 copying lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,453 copying lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,455 copying lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,457 copying lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,459 copying lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,461 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,463 copying lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,465 copying lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,467 copying lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,470 copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,472 copying lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,474 copying lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,476 copying lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,478 copying lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,480 copying lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,483 copying lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,485 copying lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,487 copying lm_eval/tasks/bigbench/generate_until/color.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,489 copying lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,491 copying lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,493 copying lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,495 copying lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,497 copying lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,499 copying lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,501 copying lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,503 copying lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,506 copying lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,508 copying lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,510 copying lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,512 copying lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,514 copying lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,515 copying lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,517 copying lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,520 copying lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,522 copying lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,524 copying lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,526 copying lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,528 copying lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,530 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,532 copying lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,534 copying lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,536 copying lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,539 copying lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,541 copying lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,543 copying lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,545 copying lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,547 copying lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,549 copying lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,551 copying lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,553 copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,556 copying lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,558 copying lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,560 copying lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,562 copying lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,564 copying lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,566 copying lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,568 copying lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,570 copying lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,572 copying lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,574 copying lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,576 copying lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,578 copying lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,580 copying lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,583 copying lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,585 copying lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,587 copying lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,589 copying lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,591 copying lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,594 copying lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,596 copying lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,598 copying lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,600 copying lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,602 copying lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,605 copying lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,607 copying lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,609 copying lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,611 copying lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,613 copying lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,615 copying lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,617 copying lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,619 copying lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,621 copying lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,623 copying lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,625 copying lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,627 copying lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,629 copying lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,632 copying lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,634 copying lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,636 copying lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,638 copying lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,640 copying lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,642 copying lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,644 copying lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,646 copying lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,648 copying lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,650 copying lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,653 copying lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,655 copying lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,657 copying lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,659 copying lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,662 copying lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,664 copying lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,666 copying lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,668 copying lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,670 copying lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,672 copying lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,674 copying lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,676 copying lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,678 copying lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,681 copying lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,683 copying lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,685 copying lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,687 copying lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,689 copying lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,691 copying lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,693 copying lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,695 copying lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,698 copying lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:25:22,700 creating build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,700 copying lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,703 copying lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,705 copying lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,707 copying lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,709 copying lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,711 copying lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,713 copying lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,715 copying lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,718 copying lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,720 copying lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,722 copying lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,724 copying lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,726 copying lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,728 copying lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,730 copying lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,732 copying lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,734 copying lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,737 copying lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,739 copying lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,741 copying lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,743 copying lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,745 copying lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,747 copying lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,749 copying lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,752 copying lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,754 copying lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,756 copying lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,758 copying lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,760 copying lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,763 copying lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,765 copying lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,767 copying lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,769 copying lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,772 copying lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,775 copying lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,778 copying lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,781 copying lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,783 copying lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,785 copying lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,788 copying lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,790 copying lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,792 copying lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,794 copying lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,796 copying lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,799 copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,801 copying lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,803 copying lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,805 copying lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,807 copying lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,809 copying lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,811 copying lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,813 copying lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,816 copying lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,818 copying lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,820 copying lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,822 copying lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,824 copying lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,826 copying lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,829 copying lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,831 copying lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,833 copying lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,835 copying lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,837 copying lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,839 copying lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,842 copying lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,844 copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,846 copying lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,848 copying lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,851 copying lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,853 copying lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,855 copying lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,857 copying lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,859 copying lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,862 copying lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,864 copying lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,866 copying lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,868 copying lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,870 copying lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,873 copying lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,875 copying lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,877 copying lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,879 copying lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,882 copying lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,884 copying lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,886 copying lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,888 copying lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,891 copying lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,893 copying lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,895 copying lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,897 copying lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,900 copying lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,902 copying lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,904 copying lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,907 copying lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,909 copying lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,911 copying lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,913 copying lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,916 copying lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,918 copying lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,920 copying lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,923 copying lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,925 copying lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,927 copying lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,930 copying lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,934 copying lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,936 copying lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,938 copying lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,940 copying lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,943 copying lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,945 copying lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,947 copying lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,950 copying lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,952 copying lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,954 copying lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,956 copying lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,959 copying lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,961 copying lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,963 copying lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,965 copying lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:25:22,968 copying lm_eval/tasks/babilong/babilong.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,970 copying lm_eval/tasks/babilong/babilong_longctx.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,973 copying lm_eval/tasks/babilong/babilong_qa1.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,975 copying lm_eval/tasks/babilong/babilong_qa16.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,977 copying lm_eval/tasks/babilong/babilong_qa6.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,979 copying lm_eval/tasks/babilong/babilong_qa5.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,982 copying lm_eval/tasks/babilong/babilong_qa12.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,984 copying lm_eval/tasks/babilong/babilong_qa20.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,987 copying lm_eval/tasks/babilong/babilong_qa8.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,989 copying lm_eval/tasks/babilong/babilong_qa19.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,992 copying lm_eval/tasks/babilong/babilong_qa15.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,994 copying lm_eval/tasks/babilong/babilong_qa7.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,996 copying lm_eval/tasks/babilong/babilong_qa18.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:22,998 copying lm_eval/tasks/babilong/babilong_qa9.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:23,000 copying lm_eval/tasks/babilong/babilong_qa11.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:23,003 copying lm_eval/tasks/babilong/babilong_qa17.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:23,005 copying lm_eval/tasks/babilong/babilong_qa10.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:23,007 copying lm_eval/tasks/babilong/babilong_qa4.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:23,009 copying lm_eval/tasks/babilong/babilong_qa13.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:23,012 copying lm_eval/tasks/babilong/babilong_qa14.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:23,014 copying lm_eval/tasks/babilong/babilong_qa3.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:23,017 copying lm_eval/tasks/babilong/babilong_qa2.yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:23,019 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,021 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,024 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,026 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,029 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,031 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,034 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,037 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,039 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,042 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,044 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,046 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,049 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,051 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,053 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,056 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,058 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,061 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,063 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,066 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,068 copying lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,071 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,073 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,075 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,078 copying lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,080 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,082 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,084 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,087 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,089 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:23,091 copying lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,094 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,096 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,098 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,100 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,103 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,105 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,108 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,110 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,112 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,114 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,116 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,118 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,121 copying lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,123 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,125 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,127 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,129 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,131 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,134 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,136 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,138 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,141 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,143 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,146 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,148 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,150 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,152 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,154 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,156 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:23,158 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,160 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,162 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,164 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,167 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,169 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,171 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,174 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,176 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,178 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,181 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,183 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,185 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,188 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,190 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,193 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,195 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,197 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,199 copying lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,201 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,204 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,206 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,208 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,210 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,212 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,215 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,217 copying lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,219 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,221 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,223 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:23,225 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,227 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,229 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,231 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,233 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,235 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,237 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,239 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,242 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,244 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,246 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,248 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,250 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,252 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,254 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,257 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,259 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,261 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,263 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,265 copying lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,267 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,269 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,271 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,273 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,275 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,278 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,280 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,282 copying lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,284 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,286 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:23,288 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,290 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,293 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,295 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,297 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,299 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,301 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,303 copying lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,305 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,308 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,310 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,312 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,314 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,317 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,319 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,321 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,323 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,326 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,328 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,330 copying lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,332 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,335 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,337 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,339 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,341 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,343 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,345 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,347 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,350 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,351 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:23,353 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,356 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,358 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,360 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,362 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,364 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,366 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,368 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,370 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,372 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,374 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,377 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,379 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,381 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,383 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,386 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,388 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,390 copying lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,392 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,394 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,396 copying lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,399 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,401 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,403 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,405 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,407 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,410 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,412 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,414 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,416 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:23,418 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,420 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,422 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,424 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,426 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,428 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,430 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,432 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,434 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,437 copying lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,439 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,441 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,443 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,445 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,447 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,449 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,452 copying lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,454 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,456 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,458 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,460 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,462 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,465 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,467 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,469 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,471 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,473 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,475 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,478 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,480 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:23,482 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,484 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,486 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,488 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,490 copying lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,492 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,494 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,496 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,499 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,501 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,503 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,505 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,507 copying lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,509 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,511 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,513 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,516 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,518 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,520 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,522 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,524 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,526 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,528 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,530 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,532 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,535 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,537 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,539 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,541 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,543 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:23,546 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,548 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,551 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,553 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,555 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,557 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,559 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,562 copying lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,564 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,566 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,568 copying lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,570 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,572 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,575 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,577 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,579 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,581 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,583 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,585 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,587 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,589 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,592 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,594 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,596 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,598 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,600 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,602 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,604 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,606 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,609 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:23,611 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,613 copying lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,616 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,618 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,620 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,622 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,624 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,626 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,628 copying lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,630 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,632 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,634 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,636 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,638 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,640 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,643 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,645 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,647 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,650 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,652 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,654 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,656 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,658 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,660 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,662 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,664 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,666 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,669 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,671 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,673 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:23,675 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,677 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,679 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,682 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,684 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,686 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,688 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,690 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,692 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,694 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,697 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,698 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,701 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,702 copying lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,704 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,707 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,709 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,711 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,713 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,715 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,717 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,719 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,721 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,723 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,726 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,728 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,730 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,732 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,734 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,736 copying lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:23,738 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,740 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,742 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,745 copying lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,747 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,749 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,751 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,753 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,755 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,758 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,760 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,762 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,764 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,766 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,768 copying lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,770 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,772 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,774 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,777 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,779 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,781 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,783 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,785 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,787 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,789 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,792 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,794 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,796 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,798 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,800 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:23,802 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,804 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,807 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,809 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,811 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,813 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,815 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,817 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,820 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,822 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,824 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,826 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,828 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,830 copying lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,832 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,834 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,836 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,838 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,840 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,843 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,845 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,847 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,849 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,851 copying lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,853 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,855 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,858 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,860 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,862 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,864 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:23,882 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,884 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,886 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,889 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,891 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,893 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,895 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,897 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,900 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,902 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,904 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,906 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,908 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,910 copying lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,912 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,914 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,916 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,918 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,920 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,922 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,925 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,927 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,929 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,931 copying lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,933 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,935 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,937 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,939 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,942 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,944 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:23,946 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,948 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,950 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,952 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,954 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,956 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,958 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,960 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,962 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,964 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,966 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,968 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,970 copying lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,972 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,974 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,976 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,978 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,980 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,982 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,984 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,986 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,988 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,990 copying lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,992 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,994 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,996 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:23,998 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:24,000 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:24,002 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:24,004 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:24,006 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,008 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,010 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,012 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,015 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,017 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,019 copying lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,021 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,023 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,026 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,028 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,030 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,032 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,034 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,036 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,038 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,040 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,042 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,044 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,046 copying lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,048 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,050 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,052 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,054 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,056 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,058 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,060 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,062 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,064 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,066 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:24,068 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,070 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,072 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,074 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,076 copying lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,078 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,081 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,083 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,085 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,087 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,090 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,092 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,094 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,096 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,099 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,101 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,103 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,105 copying lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,107 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,109 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,111 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,113 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,115 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,117 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,119 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,121 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,123 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,125 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,127 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,129 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:24,131 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,133 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,135 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,137 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,139 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,141 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,144 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,146 copying lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,148 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,150 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,152 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,154 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,156 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,158 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,160 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,162 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,165 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,167 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,169 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,171 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,173 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,175 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,177 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,179 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,181 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,183 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,185 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,187 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,189 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,191 copying lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:24,193 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,195 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,197 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,199 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,201 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,204 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,206 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,208 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,210 copying lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,212 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,214 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,216 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,218 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,220 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,222 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,224 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,226 copying lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,228 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,231 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,233 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,234 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,237 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,239 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,240 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,242 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,244 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,246 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,248 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,250 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,252 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:24,254 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,256 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,258 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,261 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,263 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,265 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,267 copying lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,269 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,271 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,273 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,275 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,277 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,279 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,281 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,283 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,285 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,287 copying lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,289 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,292 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,294 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,296 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,298 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,300 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,302 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,305 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,307 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,309 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,311 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,313 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,315 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:24,317 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,319 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,321 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,323 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,325 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,327 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,329 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,331 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,333 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,336 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,338 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,340 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,343 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,345 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,347 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,350 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,352 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,354 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,356 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,358 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,360 copying lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,363 copying lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,364 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,366 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,368 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,370 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,372 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,374 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,376 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,378 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:24,381 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,383 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,385 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,387 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,389 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,391 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,393 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,396 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,398 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,400 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,402 copying lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,404 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,406 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,408 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,410 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,413 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,415 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,417 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,419 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,421 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,423 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,425 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,427 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,430 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,432 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,434 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,436 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,438 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,440 copying lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,442 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:24,444 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,446 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,448 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,450 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,452 copying lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,454 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,456 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,458 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,460 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,462 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,464 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,466 copying lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,468 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,470 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,472 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,474 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,477 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,479 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,481 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,483 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,485 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,487 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,489 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,491 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,493 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,495 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,497 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,499 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,501 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,503 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:24,505 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,507 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,509 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,511 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,513 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,515 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,517 copying lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,519 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,521 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,523 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,526 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,528 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,530 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,532 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,534 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,537 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,539 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,541 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,543 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,545 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,547 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,549 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,552 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,554 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,556 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,559 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,561 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,563 copying lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,565 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,567 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:24,569 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,571 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,573 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,575 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,577 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,579 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,582 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,584 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,586 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,588 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,590 copying lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,592 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,594 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,596 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,598 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,601 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,603 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,605 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,607 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,609 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,611 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,613 copying lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,615 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,617 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,619 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,622 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,624 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,626 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,628 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,630 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:24,632 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,634 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,636 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,638 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,640 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,643 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,645 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,647 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,649 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,651 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,653 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,655 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,657 copying lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,660 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,662 copying lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,664 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,666 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,668 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,670 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,673 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,675 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,677 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,679 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,681 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,683 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,685 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,688 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,690 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,692 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,694 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:24,697 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,699 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,701 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,703 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,705 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,707 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,709 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,711 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,713 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,716 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,718 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,720 copying lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,722 copying lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,724 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,726 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,728 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,731 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,733 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,735 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,737 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,739 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,742 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,744 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,746 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,748 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,750 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,752 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,755 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,757 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,759 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:24,761 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,763 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,766 copying lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,768 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,770 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,772 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,774 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,776 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,778 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,780 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,783 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,785 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,787 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,789 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,791 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,794 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,796 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,798 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,801 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,803 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,806 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,808 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,810 copying lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,812 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,815 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,817 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,819 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,821 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,823 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,826 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:24,828 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,830 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,833 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,835 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,837 copying lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,839 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,842 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,844 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,846 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,848 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,850 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,852 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,854 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,857 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,859 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,861 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,863 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,866 copying lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,868 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,871 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,873 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,875 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,878 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,880 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,882 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,885 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,887 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,890 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,892 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,894 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:24,897 copying lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,899 copying lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,902 copying lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,904 copying lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,906 copying lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,908 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,911 copying lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,913 copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,915 copying lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,918 copying lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,920 copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,922 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,924 copying lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,927 copying lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,929 copying lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,931 copying lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,933 copying lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,936 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,938 copying lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,940 copying lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,942 copying lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,945 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,947 copying lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,949 copying lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,952 copying lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,955 copying lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,957 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,960 copying lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,962 copying lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,964 copying lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,967 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,969 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,971 copying lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,973 copying lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,975 copying lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,978 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,980 copying lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,982 copying lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,984 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,987 copying lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,989 copying lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,991 copying lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,993 copying lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,995 copying lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:24,997 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,000 copying lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,002 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,004 copying lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,006 copying lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,008 copying lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,010 copying lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,013 copying lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,015 copying lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,017 copying lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,019 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,021 copying lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,023 copying lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,025 copying lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,027 copying lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,030 copying lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,032 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,034 copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,036 copying lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,038 copying lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,040 copying lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,042 copying lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,044 copying lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,046 copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,048 copying lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,050 copying lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,052 copying lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,054 copying lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:25,056 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,058 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,060 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,062 copying lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,064 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,066 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,068 copying lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,070 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,072 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,074 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,076 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,078 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,080 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,082 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,084 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,086 copying lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,088 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,090 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,092 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,094 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,096 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,098 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,100 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,102 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,104 copying lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,106 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,107 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,109 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,111 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,113 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,116 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,118 copying lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,120 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,122 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,123 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,125 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,128 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,129 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,131 copying lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,134 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,136 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,138 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,140 copying lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,142 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,144 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,146 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,148 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,150 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,152 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,154 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,157 copying lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,159 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,161 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,163 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,165 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,168 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,170 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,172 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,174 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,176 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,178 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,180 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:25,182 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot 2026-02-14T10:25:25,183 copying lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot 2026-02-14T10:25:25,185 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,186 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,188 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,191 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,193 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,195 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,197 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,199 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,201 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,203 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,205 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,207 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,209 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,211 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,214 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,216 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,218 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,220 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,222 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:25,224 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,225 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,227 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,229 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,231 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,234 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,236 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,238 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,240 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,242 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,244 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,247 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,249 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,251 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,253 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,255 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,257 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,260 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,262 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:25,264 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,265 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,268 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,270 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,272 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,274 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,276 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,278 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,280 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,282 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,284 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,286 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,288 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,290 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,292 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,294 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,297 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,299 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,301 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:25,303 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,304 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,306 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,308 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,310 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,312 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,315 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,317 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,319 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,321 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,323 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,325 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,327 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,329 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,331 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,333 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,335 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,337 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,339 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:25,341 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,342 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,345 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,347 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,349 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,351 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,353 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,355 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,357 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,360 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,362 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,364 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,367 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,369 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,371 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,373 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,375 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,377 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,379 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:25,381 creating build/lib/lm_eval/tasks/afrimgsm/translate 2026-02-14T10:25:25,382 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2026-02-14T10:25:25,384 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,385 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,387 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,390 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,392 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,395 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,397 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,399 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,401 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,404 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,406 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,409 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,411 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,413 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,415 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,418 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,420 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,423 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:25,425 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,426 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,428 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,430 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,432 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,434 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,437 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,439 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,441 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,443 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,445 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,447 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,449 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,451 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,454 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,456 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,458 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,460 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:25,462 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,464 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,466 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,468 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,470 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,473 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,475 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,477 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,480 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,482 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,484 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,486 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,488 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,490 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,492 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,495 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,497 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,499 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:25,501 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,502 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,505 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,507 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,509 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,511 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,514 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,516 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,518 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,520 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,522 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,524 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,526 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,529 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,531 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,533 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,535 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,537 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:25,539 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,540 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,543 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,545 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,547 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,549 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,551 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,553 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,555 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,557 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,559 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,561 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,564 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,566 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,568 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,570 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,572 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,574 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:25,576 creating build/lib/lm_eval/tasks/afrimgsm/direct 2026-02-14T10:25:25,577 copying lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2026-02-14T10:25:25,579 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,580 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,583 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,586 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,588 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,591 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,593 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,596 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,598 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,600 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,602 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,604 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,606 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,608 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,610 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,612 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,615 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,617 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,619 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,621 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:25,623 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,624 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,627 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,629 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,631 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,633 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,636 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,638 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,640 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,642 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,644 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,646 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,649 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,651 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,653 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,656 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,658 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,660 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,662 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,664 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:25,666 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,667 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,669 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,671 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,673 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,675 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,677 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,679 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,681 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,683 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,686 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,688 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,690 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,692 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,694 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,696 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,698 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,700 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,702 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,705 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:25,708 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,709 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,712 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,714 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,716 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,719 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,721 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,723 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,725 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,727 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,729 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,732 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,734 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,736 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,738 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,740 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,743 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,745 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,747 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,749 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:25,751 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,752 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,756 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,758 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,761 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,763 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,765 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,767 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,769 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,771 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,773 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,776 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,778 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,780 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,783 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,785 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,787 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,789 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,791 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,793 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:25,795 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot 2026-02-14T10:25:25,796 copying lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot 2026-02-14T10:25:25,799 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,800 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,802 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,804 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,806 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,809 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,811 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,813 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,815 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,817 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,819 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,821 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,823 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,826 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,828 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,830 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,832 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,834 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,836 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,838 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:25,841 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,841 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,844 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,846 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,848 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,850 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,852 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,854 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,856 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,858 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,860 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,863 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,865 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,867 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,869 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,871 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,873 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,875 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,877 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,879 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:25,881 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,882 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,885 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,887 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,889 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,891 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,894 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,896 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,898 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,900 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,902 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,904 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,907 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,909 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,911 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,913 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,915 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,917 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,919 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,921 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:25,923 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,924 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,926 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,928 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,930 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,933 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,935 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,937 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,939 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,942 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,944 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,946 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,948 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,950 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,953 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,955 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,957 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,960 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,963 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,967 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:25,972 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:25,975 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:25,980 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:25,982 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:25,984 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:25,987 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:25,989 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:25,991 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:25,993 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:25,996 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:25,998 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:26,000 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:26,002 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:26,004 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:26,007 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:26,009 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:26,011 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:26,013 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:26,015 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:26,018 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:26,020 copying lm_eval/tasks/coqa/default.yaml -> build/lib/lm_eval/tasks/coqa 2026-02-14T10:25:26,022 copying lm_eval/tasks/esbbq/esbbq_spanish_region.yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:26,024 copying lm_eval/tasks/esbbq/esbbq_disability_status.yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:26,026 copying lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:26,028 copying lm_eval/tasks/esbbq/esbbq_age.yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:26,030 copying lm_eval/tasks/esbbq/esbbq.yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:26,032 copying lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:26,034 copying lm_eval/tasks/esbbq/esbbq_gender.yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:26,037 copying lm_eval/tasks/esbbq/esbbq_ses.yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:26,039 copying lm_eval/tasks/esbbq/esbbq_religion.yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:26,041 copying lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:26,043 copying lm_eval/tasks/esbbq/esbbq_nationality.yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:26,045 copying lm_eval/tasks/mbpp/mbpp_plus.yaml -> build/lib/lm_eval/tasks/mbpp 2026-02-14T10:25:26,047 copying lm_eval/tasks/mbpp/mbpp.yaml -> build/lib/lm_eval/tasks/mbpp 2026-02-14T10:25:26,049 copying lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml -> build/lib/lm_eval/tasks/mbpp 2026-02-14T10:25:26,051 copying lm_eval/tasks/mbpp/mbpp_instruct.yaml -> build/lib/lm_eval/tasks/mbpp 2026-02-14T10:25:26,053 creating build/lib/lm_eval/tasks/nq_open 2026-02-14T10:25:26,054 copying lm_eval/tasks/nq_open/nq_open.yaml -> build/lib/lm_eval/tasks/nq_open 2026-02-14T10:25:26,057 copying lm_eval/tasks/aime/aime.yaml -> build/lib/lm_eval/tasks/aime 2026-02-14T10:25:26,059 copying lm_eval/tasks/aime/aime25.yaml -> build/lib/lm_eval/tasks/aime 2026-02-14T10:25:26,061 copying lm_eval/tasks/aime/aime24.yaml -> build/lib/lm_eval/tasks/aime 2026-02-14T10:25:26,063 creating build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:26,064 copying lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:26,066 copying lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:26,068 copying lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:26,070 copying lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:26,073 copying lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:26,075 copying lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:26,077 copying lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:26,079 copying lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:26,081 copying lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:26,083 copying lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:26,086 copying lm_eval/tasks/noticia/noticia.yaml -> build/lib/lm_eval/tasks/noticia 2026-02-14T10:25:26,088 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,090 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,092 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,094 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,096 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,099 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,101 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,103 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,105 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,107 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,109 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,111 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,113 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,115 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,118 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,120 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,122 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,124 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,126 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,128 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,130 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,132 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,134 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,137 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,139 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,141 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,143 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,145 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,147 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,149 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,152 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,154 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,156 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,158 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,160 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,162 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,164 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,166 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,168 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,171 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,173 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,175 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,177 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,179 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,181 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,183 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,185 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,187 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,190 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,192 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,194 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,196 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,198 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,201 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,203 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,205 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,207 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,210 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,212 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,214 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,216 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,219 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,221 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,224 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,226 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,228 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,230 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,232 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,234 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,237 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,239 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,241 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,243 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,246 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,248 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,251 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,253 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,256 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,258 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,260 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,262 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,264 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,266 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,268 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,270 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,273 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,275 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,277 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,279 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,281 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,283 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,286 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,288 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,290 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,292 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,294 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,296 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,298 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,301 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,303 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,305 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,307 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,309 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,312 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,314 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,316 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,318 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,320 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,322 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,324 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,327 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,329 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,331 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,333 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,335 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,337 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,339 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,341 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,343 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,346 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,348 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,350 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,352 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,354 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,356 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,358 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,360 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,363 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,365 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,367 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,369 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,371 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,373 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,375 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,377 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,380 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,382 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,384 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,386 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,388 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,391 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,393 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,395 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,397 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,399 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,401 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,403 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,406 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,408 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,410 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,412 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,414 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,416 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,418 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,420 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,423 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,425 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,427 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,429 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,432 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,434 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,436 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,438 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,441 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,443 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,445 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,447 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,450 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,452 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,454 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,456 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,458 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,460 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,463 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,465 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,467 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,469 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,471 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,473 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,476 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,478 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,480 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,482 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,484 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,487 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,489 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,491 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,493 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,495 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,498 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,500 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,502 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,504 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,506 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,509 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,511 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,513 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,515 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,517 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,519 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,521 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,523 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,526 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,528 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,530 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,532 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,534 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,537 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,539 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,541 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,544 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,546 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,548 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,550 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,552 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,554 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,556 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,559 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,561 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,563 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,565 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,567 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,569 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,571 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,573 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,575 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,577 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,579 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,581 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,583 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,586 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,588 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,590 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,592 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,594 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,596 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,599 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,601 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,603 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,605 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,607 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,610 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,612 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,614 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,616 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,618 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,621 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,623 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,625 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,627 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,629 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,631 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,633 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,636 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,638 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,640 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,642 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,644 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,647 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,649 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,651 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,653 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,655 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,658 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,660 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,662 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,664 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,666 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,668 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,671 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,673 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,675 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,677 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,679 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,682 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,684 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,686 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,688 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,690 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,692 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,694 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,697 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,699 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,701 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,704 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,706 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,709 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,711 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,713 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,715 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,718 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,720 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,722 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,724 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,727 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,729 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,731 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,733 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,736 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,738 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,741 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,743 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,746 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,748 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,750 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,752 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,754 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,757 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,759 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,761 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,763 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,765 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,768 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,770 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,772 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,774 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,777 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,779 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,781 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,784 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,786 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,789 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,791 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,793 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,796 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,798 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,800 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,802 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,805 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,807 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,809 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,811 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,813 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,815 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,818 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,820 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,822 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,824 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,826 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,828 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,830 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,832 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,835 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,837 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,839 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,841 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,843 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,846 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,848 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,850 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,853 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,855 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,857 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,859 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,862 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,864 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,866 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,868 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,870 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,873 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,875 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,877 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,879 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,881 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,883 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,885 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,887 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,889 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,891 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,893 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,895 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,897 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,899 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,901 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,904 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,906 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,908 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,910 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,912 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,914 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,916 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,919 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,921 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,923 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,925 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,927 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,929 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,931 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,933 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,935 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,938 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,940 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,942 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,944 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,946 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,948 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,950 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,952 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,954 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,956 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,958 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,961 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,963 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,965 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,967 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,969 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,971 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,973 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,975 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,977 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,980 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,982 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,984 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,986 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,988 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,990 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,992 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,994 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,996 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:26,998 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,000 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,002 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,004 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,007 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,009 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,011 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,013 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,015 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,017 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,019 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,021 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,023 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,025 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,027 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,029 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,032 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,033 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,036 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,038 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,040 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,042 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,044 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,046 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,048 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,050 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,052 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,054 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,056 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,058 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,060 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,062 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,064 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,066 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,068 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,070 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,072 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,075 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,077 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,079 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,081 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,083 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,085 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,087 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,089 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,091 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,093 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,095 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,097 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,099 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,101 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,104 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,106 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,108 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,110 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,112 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,114 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,116 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,118 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,120 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,122 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,124 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,127 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,129 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,131 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,133 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,135 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,137 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,139 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,141 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,143 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,145 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,148 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,150 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,152 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,154 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,156 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,158 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,160 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,162 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,164 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,166 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,168 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,170 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,172 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,174 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,176 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,178 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,180 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,183 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,185 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,187 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,189 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,191 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,193 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,196 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,198 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,200 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,202 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,204 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,206 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,208 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,210 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,212 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,214 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,217 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,218 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,221 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,223 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,225 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,227 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,229 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,231 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,233 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,235 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,237 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,239 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,241 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,243 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,246 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,248 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,250 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,252 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,254 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,256 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,258 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,260 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,263 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,265 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,267 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,269 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,271 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,273 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,275 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,277 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,279 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,281 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,283 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,285 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,287 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,289 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,292 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,294 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,296 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,298 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,300 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,302 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,304 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,306 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,308 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,310 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,312 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,315 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,317 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,319 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,321 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,323 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,325 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,327 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,329 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,331 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,333 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,335 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,337 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,339 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,341 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,344 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,346 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,348 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,350 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,352 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,355 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,357 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,359 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,362 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,364 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,366 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,369 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,371 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,374 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,376 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,378 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,381 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,383 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,385 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,387 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,390 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,392 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,394 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,396 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,399 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,401 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,403 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,406 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,408 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,410 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,412 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,415 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,417 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,419 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,422 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,424 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,426 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,428 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,431 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,433 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,436 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,438 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,440 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,442 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,445 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,447 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,449 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,451 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,453 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,455 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,457 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,459 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,462 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,464 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,466 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,468 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,470 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,472 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,474 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,477 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,479 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,481 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,483 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,486 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,488 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,490 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,492 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,494 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,497 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,499 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,501 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,503 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,505 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,508 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,510 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,512 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,514 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,517 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,519 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,521 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,523 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,525 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,528 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,530 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,532 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,534 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,537 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,539 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,541 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,543 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,545 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,547 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,550 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,552 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,554 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,556 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,559 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,561 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,563 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,565 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,568 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,570 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,572 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,574 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,576 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,578 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,581 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,583 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,585 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,587 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,589 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,592 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,594 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,596 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,598 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,601 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,603 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,605 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,607 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,610 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,612 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,614 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,617 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,619 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,621 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,623 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,625 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,627 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,630 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,632 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,634 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,636 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,639 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,641 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,643 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,645 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,648 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,650 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,652 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,655 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,657 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,659 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,661 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,664 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,666 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,668 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,670 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,673 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,675 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,677 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,679 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,682 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,684 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,686 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,688 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,690 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,692 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,694 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,696 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,699 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,701 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,703 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,706 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,708 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,710 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,712 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,715 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,717 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,719 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,721 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,723 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,726 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,728 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,730 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,732 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,735 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,737 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,739 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,742 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,744 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,747 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,749 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,752 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,754 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,756 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,758 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,761 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,763 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,765 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,767 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,770 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,772 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,774 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,777 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,779 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,781 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,784 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,786 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,788 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,790 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,793 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,795 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,797 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,799 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,802 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,804 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,806 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,808 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,810 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,812 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,814 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,817 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,819 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,821 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,823 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,825 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,828 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,830 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,832 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,835 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,837 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,839 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,841 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,843 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,846 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,848 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,850 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,853 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,855 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,858 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,860 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,862 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,864 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,867 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,869 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,870 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,873 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,875 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,877 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,879 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,881 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,883 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,886 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,888 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,890 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,892 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,895 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,897 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,899 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,902 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,904 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,906 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,909 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,911 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,913 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,916 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,918 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,921 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,923 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,925 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,927 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,930 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,932 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,934 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,936 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,939 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,941 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,943 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,946 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,948 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,951 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,953 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,955 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,958 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,960 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,962 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,964 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,966 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,969 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,971 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,974 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,976 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,978 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,981 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:27,983 creating build/lib/lm_eval/tasks/kormedmcqa 2026-02-14T10:25:27,984 copying lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-02-14T10:25:27,987 copying lm_eval/tasks/kormedmcqa/nurse.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-02-14T10:25:27,989 copying lm_eval/tasks/kormedmcqa/pharm.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-02-14T10:25:27,991 copying lm_eval/tasks/kormedmcqa/doctor.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-02-14T10:25:27,993 copying lm_eval/tasks/kormedmcqa/dentist.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-02-14T10:25:27,996 copying lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/lib/lm_eval/tasks/wmt2016 2026-02-14T10:25:27,998 creating build/lib/lm_eval/tasks/fld 2026-02-14T10:25:27,999 copying lm_eval/tasks/fld/fld_default.yaml -> build/lib/lm_eval/tasks/fld 2026-02-14T10:25:28,001 copying lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/lib/lm_eval/tasks/fld 2026-02-14T10:25:28,004 copying lm_eval/tasks/fld/fld_star.yaml -> build/lib/lm_eval/tasks/fld 2026-02-14T10:25:28,006 copying lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/lib/lm_eval/tasks/fld 2026-02-14T10:25:28,009 copying lm_eval/tasks/squad_completion/squad_completion.yaml -> build/lib/lm_eval/tasks/squad_completion 2026-02-14T10:25:28,011 copying lm_eval/tasks/hrm8k/default/hrm8k.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-02-14T10:25:28,013 copying lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-02-14T10:25:28,015 copying lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-02-14T10:25:28,018 copying lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-02-14T10:25:28,020 copying lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-02-14T10:25:28,022 copying lm_eval/tasks/hrm8k/default/hrm8k_math.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-02-14T10:25:28,024 copying lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-02-14T10:25:28,027 copying lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-02-14T10:25:28,029 copying lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-02-14T10:25:28,031 copying lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-02-14T10:25:28,033 copying lm_eval/tasks/hrm8k/en/hrm8k_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-02-14T10:25:28,036 copying lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-02-14T10:25:28,038 copying lm_eval/tasks/mlqa/mlqa_vi_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,041 copying lm_eval/tasks/mlqa/mlqa_vi_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,043 copying lm_eval/tasks/mlqa/mlqa_es_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,045 copying lm_eval/tasks/mlqa/mlqa_hi_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,048 copying lm_eval/tasks/mlqa/mlqa_zh_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,050 copying lm_eval/tasks/mlqa/mlqa_de_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,052 copying lm_eval/tasks/mlqa/mlqa_vi_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,055 copying lm_eval/tasks/mlqa/mlqa_de_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,057 copying lm_eval/tasks/mlqa/mlqa_hi_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,059 copying lm_eval/tasks/mlqa/mlqa_zh_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,062 copying lm_eval/tasks/mlqa/mlqa_en_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,064 copying lm_eval/tasks/mlqa/mlqa_es_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,066 copying lm_eval/tasks/mlqa/mlqa_en_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,069 copying lm_eval/tasks/mlqa/mlqa_ar_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,071 copying lm_eval/tasks/mlqa/mlqa_vi_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,073 copying lm_eval/tasks/mlqa/mlqa_vi_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,076 copying lm_eval/tasks/mlqa/mlqa_vi_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,078 copying lm_eval/tasks/mlqa/mlqa_de_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,080 copying lm_eval/tasks/mlqa/mlqa_ar_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,082 copying lm_eval/tasks/mlqa/mlqa_en_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,084 copying lm_eval/tasks/mlqa/mlqa_hi_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,087 copying lm_eval/tasks/mlqa/mlqa_zh_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,089 copying lm_eval/tasks/mlqa/mlqa_zh_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,091 copying lm_eval/tasks/mlqa/mlqa_ar_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,093 copying lm_eval/tasks/mlqa/mlqa_es_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,095 copying lm_eval/tasks/mlqa/mlqa_de_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,097 copying lm_eval/tasks/mlqa/mlqa_zh_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,100 copying lm_eval/tasks/mlqa/mlqa_hi_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,102 copying lm_eval/tasks/mlqa/mlqa_en_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,104 copying lm_eval/tasks/mlqa/mlqa_es_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,106 copying lm_eval/tasks/mlqa/mlqa_es_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,109 copying lm_eval/tasks/mlqa/mlqa_ar_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,111 copying lm_eval/tasks/mlqa/mlqa_vi_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,114 copying lm_eval/tasks/mlqa/mlqa_de_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,116 copying lm_eval/tasks/mlqa/mlqa_zh_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,118 copying lm_eval/tasks/mlqa/mlqa_en_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,120 copying lm_eval/tasks/mlqa/mlqa_zh_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,123 copying lm_eval/tasks/mlqa/mlqa_es_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,125 copying lm_eval/tasks/mlqa/mlqa_hi_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,127 copying lm_eval/tasks/mlqa/mlqa_hi_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,129 copying lm_eval/tasks/mlqa/mlqa_ar_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,131 copying lm_eval/tasks/mlqa/mlqa_hi_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,134 copying lm_eval/tasks/mlqa/mlqa_ar_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,136 copying lm_eval/tasks/mlqa/mlqa_en_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,138 copying lm_eval/tasks/mlqa/mlqa_en_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,140 copying lm_eval/tasks/mlqa/mlqa_de_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,143 copying lm_eval/tasks/mlqa/mlqa_de_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,145 copying lm_eval/tasks/mlqa/mlqa_ar_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,147 copying lm_eval/tasks/mlqa/mlqa_es_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:28,150 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,152 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,155 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,157 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,160 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,162 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,164 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,166 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,169 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,171 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,174 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,176 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,178 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,181 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,183 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,186 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,188 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,190 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,193 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,196 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,198 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,200 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,203 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,206 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,208 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,211 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,213 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,216 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,218 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,221 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,224 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,226 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,229 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,231 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,234 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,236 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,238 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,241 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,243 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,246 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,248 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,250 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,253 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,255 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,257 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,260 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,262 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,264 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,266 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,269 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,271 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,274 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,276 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,278 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,281 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,283 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,285 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,288 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,291 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,293 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,295 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,298 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:28,300 creating build/lib/lm_eval/tasks/llama3/instruct/gsm8k 2026-02-14T10:25:28,301 copying lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml -> build/lib/lm_eval/tasks/llama3/instruct/gsm8k 2026-02-14T10:25:28,304 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,306 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,308 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,311 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,313 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,316 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,318 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,321 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,323 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,326 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,328 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,331 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,333 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,336 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,338 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,341 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,343 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,346 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,348 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,351 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,354 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,357 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,359 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,362 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,364 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,366 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,368 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,371 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,374 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,376 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,379 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,381 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,383 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,386 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,388 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,391 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,393 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,395 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,398 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,400 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,403 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,405 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,408 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,410 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,413 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,416 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,418 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,421 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,424 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,427 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,430 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,433 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,436 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,439 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,442 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,445 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,448 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,451 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,454 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,458 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,461 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,464 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:28,467 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,470 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,473 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,477 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,480 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,482 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,485 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,488 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,491 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,494 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,497 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,500 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,503 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,506 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,509 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,511 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,514 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,517 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,520 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,523 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,525 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,528 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,531 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,533 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,535 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,538 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,541 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,543 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,546 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,548 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,551 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,553 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,555 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,558 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,560 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,563 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,566 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,568 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,571 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,573 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,576 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,578 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,580 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,583 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,585 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,588 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,590 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,592 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,595 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,598 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,600 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,603 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,605 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,607 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,610 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,612 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,614 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,617 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,619 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,621 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,624 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,627 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:28,629 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,632 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,634 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,637 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,639 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,641 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,643 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,645 copying lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,648 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,650 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,652 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,655 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,657 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,659 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,661 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:28,664 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,667 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,670 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,672 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,675 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,678 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,680 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,683 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,686 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,688 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,691 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,694 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,697 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,699 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,702 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,705 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,708 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,710 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,713 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,716 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,718 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,721 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,724 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,727 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,730 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,733 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,736 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,739 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,742 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,746 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,749 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,752 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,755 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,758 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,761 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,764 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,767 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,770 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,773 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,776 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,779 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,782 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,786 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,789 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,792 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,796 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,799 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,802 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,805 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,808 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,811 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,814 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,818 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,821 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,824 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,828 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,832 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,835 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,838 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,841 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,844 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,847 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:28,850 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,853 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,856 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,859 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,862 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,865 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,869 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,872 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,876 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,879 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,882 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,885 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,888 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,891 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,894 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,898 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,901 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,904 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,907 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,910 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,913 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,916 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,919 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,924 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,927 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,930 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,933 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,936 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,940 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,943 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,946 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,948 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,951 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,954 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,957 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,959 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,962 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,965 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,967 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,970 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,972 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,975 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,978 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,980 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,983 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,986 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,989 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,991 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:28,994 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,007 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,009 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,013 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,016 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,019 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,021 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,024 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,028 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,031 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,033 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,036 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,039 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,041 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:29,044 copying lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2026-02-14T10:25:29,047 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,049 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,052 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,054 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,056 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,059 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,062 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,064 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,067 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,070 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,072 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,074 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,077 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,079 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,081 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,084 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,086 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,088 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,091 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,093 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,096 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,098 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,101 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,104 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,106 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,109 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,111 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,113 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,116 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,118 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,120 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,122 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,125 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,127 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,130 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,132 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,134 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,137 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,140 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,143 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,145 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,148 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,150 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,153 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,155 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,158 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,160 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,163 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,165 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,167 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,170 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,172 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,175 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,177 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,180 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,183 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,185 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,188 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,190 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,193 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,195 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,197 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:29,200 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,201 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,203 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,206 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,208 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,210 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,212 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,214 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,217 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,219 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,221 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,223 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,226 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,228 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,231 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,234 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,237 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,241 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,244 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,247 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,250 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,253 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,255 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,258 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,261 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,264 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,267 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,270 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,273 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,276 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,279 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,282 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,285 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,288 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,291 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,294 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,297 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,300 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,303 copying lm_eval/tasks/llama3/instruct/mmlu/llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,306 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,309 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,312 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,315 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,318 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,321 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,324 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,327 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,330 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,332 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,334 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,336 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,339 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,341 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,343 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,346 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,348 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,350 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,352 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,355 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,357 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,359 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,362 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,364 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:29,366 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,367 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,370 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,372 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,374 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,377 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,379 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,381 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,384 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,386 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,388 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,391 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,393 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,395 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,398 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,400 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,402 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,404 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,406 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,408 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,411 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,413 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,415 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,418 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,420 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,422 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,425 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,428 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,430 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,432 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,434 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,437 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,439 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,441 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,444 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,446 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,448 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,450 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,453 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,455 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,458 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,460 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,462 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,464 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,467 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,469 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,471 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,474 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,476 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,478 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,481 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,483 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,485 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,488 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,490 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,493 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,495 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,497 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,500 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,502 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,504 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,507 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,509 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:29,511 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,514 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,517 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,520 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,522 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,525 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,527 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,530 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,532 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,535 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,537 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,540 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,543 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,545 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,548 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,551 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,553 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,556 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,558 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,561 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,563 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,565 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,568 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,571 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,573 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,576 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,578 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,581 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,583 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,586 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,588 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,590 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,593 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,595 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,598 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,600 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,603 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,605 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,608 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,610 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,612 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,615 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,617 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,620 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,622 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,625 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,628 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,630 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,632 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,635 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,637 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,640 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,642 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,645 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,647 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,649 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,653 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,655 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,657 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,660 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,662 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,664 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:29,668 copying lm_eval/tasks/aradice/aradice.yaml -> build/lib/lm_eval/tasks/aradice 2026-02-14T10:25:29,670 copying lm_eval/tasks/aradice/piqa/piqa_egy.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-02-14T10:25:29,672 copying lm_eval/tasks/aradice/piqa/piqa_msa.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-02-14T10:25:29,675 copying lm_eval/tasks/aradice/piqa/piqa_lev.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-02-14T10:25:29,677 copying lm_eval/tasks/aradice/piqa/piqa_eng.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-02-14T10:25:29,679 copying lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-02-14T10:25:29,681 copying lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-02-14T10:25:29,683 copying lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-02-14T10:25:29,685 copying lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-02-14T10:25:29,688 copying lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-02-14T10:25:29,690 copying lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-02-14T10:25:29,692 copying lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-02-14T10:25:29,694 copying lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-02-14T10:25:29,697 copying lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:25:29,699 copying lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:25:29,701 copying lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:25:29,703 copying lm_eval/tasks/aradice/cultural-benchmark/syria.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:25:29,706 copying lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:25:29,709 copying lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:25:29,711 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:25:29,713 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:25:29,716 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:25:29,718 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:25:29,720 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,723 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,725 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,727 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,729 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,731 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,733 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,735 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,737 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,740 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,742 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,744 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,746 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,749 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,751 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,753 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,755 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,758 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,760 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,762 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,764 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,766 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,768 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,771 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,773 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,775 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,777 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,779 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,781 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,784 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,786 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,790 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,793 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,795 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,798 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,800 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,802 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,805 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,807 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,809 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,811 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:29,813 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,815 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,818 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,820 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,822 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,833 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,836 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,838 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,840 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,843 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,845 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,848 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,851 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,853 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,855 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,858 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,861 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,863 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,865 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,868 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,871 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,874 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,877 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,880 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,882 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,885 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,887 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,890 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,892 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,895 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,897 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,900 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,903 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,905 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,907 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,910 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,912 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,915 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,917 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,920 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,922 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:29,924 copying lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-02-14T10:25:29,927 copying lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-02-14T10:25:29,929 copying lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-02-14T10:25:29,932 copying lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-02-14T10:25:29,934 copying lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml -> build/lib/lm_eval/tasks/med_prescriptions 2026-02-14T10:25:29,936 copying lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml -> build/lib/lm_eval/tasks/med_prescriptions 2026-02-14T10:25:29,939 copying lm_eval/tasks/c4/c4.yaml -> build/lib/lm_eval/tasks/c4 2026-02-14T10:25:29,941 copying lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/lib/lm_eval/tasks/truthfulqa 2026-02-14T10:25:29,944 copying lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/lib/lm_eval/tasks/truthfulqa 2026-02-14T10:25:29,946 copying lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/lib/lm_eval/tasks/truthfulqa 2026-02-14T10:25:29,948 creating build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,950 copying lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,952 copying lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,955 copying lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,957 copying lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,960 copying lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,962 copying lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,964 copying lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,966 copying lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,968 copying lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,971 copying lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,973 copying lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:29,975 creating build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,976 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,978 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,980 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,982 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,984 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,986 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,988 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,990 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,993 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,995 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,997 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:29,999 creating build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,000 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,002 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,004 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,007 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,009 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,011 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,013 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,015 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,018 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,020 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,022 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:30,024 copying lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:25:30,026 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:25:30,029 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:25:30,031 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:25:30,033 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:25:30,036 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:25:30,039 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:25:30,042 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:25:30,044 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:25:30,047 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:25:30,050 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:25:30,052 copying lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:25:30,055 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:25:30,058 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:25:30,061 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:25:30,063 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:25:30,066 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:25:30,069 copying lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:25:30,071 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:25:30,074 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:25:30,077 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:25:30,080 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:25:30,082 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:25:30,085 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:25:30,088 copying lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:25:30,091 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:25:30,094 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:25:30,096 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:25:30,099 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:25:30,102 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:25:30,105 copying lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:25:30,108 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:25:30,111 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:25:30,114 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:25:30,116 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:25:30,119 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:25:30,122 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:25:30,124 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:25:30,127 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:25:30,130 copying lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:25:30,132 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:25:30,135 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:25:30,137 copying lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:25:30,140 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:25:30,142 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:25:30,144 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:25:30,146 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:25:30,148 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:25:30,151 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:25:30,153 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:25:30,155 copying lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:25:30,157 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:25:30,159 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:25:30,161 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:25:30,163 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:25:30,166 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:25:30,168 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:25:30,170 copying lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:25:30,172 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:25:30,174 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:25:30,177 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:25:30,179 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:25:30,181 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:25:30,183 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:25:30,185 copying lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:25:30,187 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:25:30,190 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:25:30,192 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:25:30,194 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:25:30,196 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:25:30,198 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:25:30,200 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:25:30,202 copying lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:25:30,205 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:25:30,207 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:25:30,209 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:25:30,211 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:25:30,213 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:25:30,216 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:25:30,218 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:25:30,220 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:25:30,222 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:25:30,224 copying lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:25:30,227 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:25:30,229 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:25:30,231 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:25:30,233 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:25:30,236 copying lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:25:30,238 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:25:30,240 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:25:30,242 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:25:30,244 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:25:30,246 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:25:30,248 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:25:30,250 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:25:30,253 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:25:30,255 copying lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:25:30,257 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:25:30,259 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:25:30,261 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:25:30,264 copying lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:25:30,266 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:25:30,268 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:25:30,270 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:25:30,273 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:25:30,275 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,277 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,280 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,282 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,284 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,286 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,289 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,291 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,293 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,296 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,298 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,300 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,302 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,305 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,307 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,309 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,311 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,313 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,315 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,317 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,319 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,322 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,324 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,326 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,328 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,331 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,333 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,335 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,337 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,339 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,342 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,344 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,346 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,349 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,351 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,353 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,355 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,357 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,359 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,362 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,364 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,366 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,368 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,370 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,372 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,374 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,376 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,378 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,381 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,383 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,385 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,388 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,390 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,393 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,395 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,397 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,399 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,401 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,403 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,405 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,408 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,410 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:30,412 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,414 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,416 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,418 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,421 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,423 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,425 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,427 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,429 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,431 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,433 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,436 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,438 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,440 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,442 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,445 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,447 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,449 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,452 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,454 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,457 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,459 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,461 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,464 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,466 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,468 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,471 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,473 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,475 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,477 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,480 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,482 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,484 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,486 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,488 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,490 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,492 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,495 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,497 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,499 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,501 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,503 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,506 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,508 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,510 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,513 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,515 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,517 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,519 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,521 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,524 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,526 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,528 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,531 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,533 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,535 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,537 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,539 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,541 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,544 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,546 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,548 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:30,550 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,552 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,554 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,556 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,559 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,561 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,563 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,565 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,567 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,570 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,572 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,574 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,576 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,579 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,581 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,583 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,585 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,588 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,590 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,592 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,594 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,596 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,598 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,601 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,603 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,605 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,607 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,609 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,611 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,613 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,616 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,618 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,620 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,623 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,625 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,627 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,629 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,631 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,634 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,636 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,638 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,641 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,643 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,645 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,647 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,649 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,651 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,653 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,655 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,658 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,660 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,662 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,664 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,666 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,668 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,671 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,673 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,675 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,677 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,679 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,681 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,683 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:30,686 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,688 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,690 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,692 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,694 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,697 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,699 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,701 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,703 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,705 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,707 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,709 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,711 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,713 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,716 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,718 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,720 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,722 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,724 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,726 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,729 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,731 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,733 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,735 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,737 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,739 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,742 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,744 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,746 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,748 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,751 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,753 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,755 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,757 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,759 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,762 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,764 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,766 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,769 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,771 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,773 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,776 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,778 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,780 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,782 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,784 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,787 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,789 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,792 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,794 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,797 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,799 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,801 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,804 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,806 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,809 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,811 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,813 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,816 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,818 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,821 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,823 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:30,825 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,828 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,830 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,832 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,834 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,836 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,839 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,841 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,843 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,845 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,847 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,849 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,852 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,854 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,856 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,859 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,861 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,864 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,866 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,868 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,871 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,873 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,876 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,878 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,881 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,883 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,885 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,887 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,889 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,892 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,894 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,896 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,899 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,901 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,903 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,905 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,908 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,910 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,912 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,915 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,917 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,919 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,922 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,924 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,927 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,929 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,931 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,933 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,936 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,938 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,940 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,942 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,945 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,947 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,949 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,951 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,953 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,956 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,959 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,961 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,963 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,965 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:30,967 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,970 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,972 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,974 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,976 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,979 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,981 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,983 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,985 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,988 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,990 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,992 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,994 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,996 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:30,999 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,001 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,003 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,005 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,007 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,009 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,011 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,014 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,016 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,018 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,020 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,022 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,024 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,026 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,029 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,031 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,034 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,036 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,038 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,040 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,043 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,045 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,047 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,050 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,052 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,054 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,057 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,059 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,061 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,063 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,065 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,068 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,070 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,072 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,074 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,077 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,079 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,081 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,083 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,086 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,088 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,090 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,092 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,094 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,097 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,099 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,101 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,103 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:31,106 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,108 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,110 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,112 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,114 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,117 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,119 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,121 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,123 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,125 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,127 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,129 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,131 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,134 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,136 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,138 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,140 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,143 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,145 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,147 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,149 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,151 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,154 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,156 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,158 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,160 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,163 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,165 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,167 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,169 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,171 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,173 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,176 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,178 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,180 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,182 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,184 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,186 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,188 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,191 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,193 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,195 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,197 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,199 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,202 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,204 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,206 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,208 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,210 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,213 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,215 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,217 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,220 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,223 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,225 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,227 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,229 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,231 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,234 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,236 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,238 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,240 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:31,242 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,245 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,247 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,249 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,251 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,254 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,256 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,258 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,260 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,263 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,266 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,268 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,270 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,272 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,275 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,277 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,279 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,281 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,284 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,286 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,288 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,290 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,292 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,295 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,297 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,299 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,302 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,304 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,306 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,308 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,310 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,313 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,315 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,317 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,319 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,322 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,324 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,326 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,328 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,331 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,333 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,335 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,337 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,340 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,342 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,344 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,346 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,348 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,351 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,353 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,355 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,357 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,359 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,361 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,363 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,366 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,368 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,370 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,372 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,374 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,377 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,379 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:31,381 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,384 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,386 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,388 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,390 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,393 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,395 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,397 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,400 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,402 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,404 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,406 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,409 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,411 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,413 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,415 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,417 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,419 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,421 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,423 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,426 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,428 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,430 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,432 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,434 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,436 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,438 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,440 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,443 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,445 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,447 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,449 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,452 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,454 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,456 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,458 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,460 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,462 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,464 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,467 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,469 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,471 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,473 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,475 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,478 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,480 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,482 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,484 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,486 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,489 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,491 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,493 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,495 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,497 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,500 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,502 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,504 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,507 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,509 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,511 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,513 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,515 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:31,517 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,520 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,522 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,524 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,526 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,528 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,530 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,532 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,534 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,537 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,539 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,541 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,543 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,546 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,548 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,551 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,553 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,555 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,557 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,559 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,562 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,564 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,566 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,568 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,571 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,573 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,575 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,577 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,579 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,581 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,584 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,586 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,588 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,591 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,593 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,596 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,598 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,600 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,602 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,604 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,607 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,609 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,611 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,613 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,616 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,618 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,620 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,622 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,624 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,627 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,629 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,631 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,633 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,636 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,638 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,640 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,642 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,644 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,647 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,649 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,651 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,653 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:31,656 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,658 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,660 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,662 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,664 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,667 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,669 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,671 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,673 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,675 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,678 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,680 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,682 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,685 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,687 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,689 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,691 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,693 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,695 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,697 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,699 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,701 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,703 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,706 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,708 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,710 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,713 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,715 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,717 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,719 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,722 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,724 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,726 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,728 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,731 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,733 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,735 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,737 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,740 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,742 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,744 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,747 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,749 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,751 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,753 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,756 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,758 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,760 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,762 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,764 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,767 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,769 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,771 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,773 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,776 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,778 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,780 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,782 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,784 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,787 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,789 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,791 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:31,794 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,796 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,798 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,801 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,803 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,805 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,807 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,809 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,811 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,813 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,816 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,818 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,820 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,822 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,825 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,827 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,829 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,832 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,834 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,837 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,839 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,841 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,844 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,846 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,849 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,851 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,853 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,856 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,858 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,861 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,863 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,865 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,867 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,869 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,871 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,873 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,876 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,878 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,880 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,882 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,884 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,886 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,888 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,891 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,893 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,895 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,897 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,899 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,901 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,904 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,906 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,908 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,910 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,912 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,915 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,917 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,919 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,921 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,923 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,926 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,928 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,930 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:31,932 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,934 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,937 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,939 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,941 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,943 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,945 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,948 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,950 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,952 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,954 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,957 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,959 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,961 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,963 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,966 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,968 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,970 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,972 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,975 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,977 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,979 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,981 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,983 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,986 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,988 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,990 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,992 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,994 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,997 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:31,999 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,001 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,003 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,006 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,008 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,010 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,012 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,014 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,017 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,019 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,021 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,023 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,026 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,028 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,030 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,032 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,034 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,037 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,039 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,041 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,043 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,045 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,048 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,050 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,052 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,054 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,056 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,059 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,061 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,063 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,065 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,068 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:32,070 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,072 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,075 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,077 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,079 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,081 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,084 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,086 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,088 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,090 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,093 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,095 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,097 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,099 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,101 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,103 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,105 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,107 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,109 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,112 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,114 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,116 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,118 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,120 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,122 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,125 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,127 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,129 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,131 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,133 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,136 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,138 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,140 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,142 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,144 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,147 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,149 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,151 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,153 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,155 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,157 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,159 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,161 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,163 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,166 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,168 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,170 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,172 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,174 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,176 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,179 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,181 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,183 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,185 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,187 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,190 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,192 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,194 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,196 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,199 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,201 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,203 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:32,206 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,208 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,210 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,212 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,214 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,216 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,218 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,220 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,222 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,224 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,227 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,229 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,231 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,233 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,235 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,237 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,240 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,242 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,244 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,246 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,248 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,251 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,253 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,255 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,258 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,260 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,262 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,264 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,266 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,268 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,271 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,273 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,275 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,277 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,279 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,281 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,283 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,285 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,288 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,290 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,292 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,294 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,296 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,299 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,301 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,303 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,305 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,307 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,310 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,312 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,314 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,316 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,319 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,321 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,323 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,325 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,327 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,329 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,332 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,334 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,336 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,338 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:32,341 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,343 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,345 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,348 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,350 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,352 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,354 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,356 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,358 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,361 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,363 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,365 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,367 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,370 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,372 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,374 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,377 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,379 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,381 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,383 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,385 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,387 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,390 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,392 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,394 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,396 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,398 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,400 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,403 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,407 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,409 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,411 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,413 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,415 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,417 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,420 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,422 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,424 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,426 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,429 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,431 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,433 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,436 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,438 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,440 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,442 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,444 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,447 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,449 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,451 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,454 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,456 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,458 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,460 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,462 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,464 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,467 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,469 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,471 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,473 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,475 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,478 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:32,480 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,482 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,484 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,487 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,489 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,491 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,494 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,496 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,498 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,500 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,502 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,504 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,506 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,508 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,511 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,513 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,515 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,517 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,519 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,521 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,523 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,526 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,528 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,530 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,532 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,535 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,537 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,540 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,542 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,544 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,546 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,549 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,551 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,553 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,556 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,558 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,560 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,562 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,564 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,566 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,568 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,570 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,573 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,575 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,577 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,580 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,582 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,584 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,586 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,588 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,591 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,593 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,595 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,597 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,600 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,602 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,604 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,607 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,609 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,611 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,613 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,615 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:32,618 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,620 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,622 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,624 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,626 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,628 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,631 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,633 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,635 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,637 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,639 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,642 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,644 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,646 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,648 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,650 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,652 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,655 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,657 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,659 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,661 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,664 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,666 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,669 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,671 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,673 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,676 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,678 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,680 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,683 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,685 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,688 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,690 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,693 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,696 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,698 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,701 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,703 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,706 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,709 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,711 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,714 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,716 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,719 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,721 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,724 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,726 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,729 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,732 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,734 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,737 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,739 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,742 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,745 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,748 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,751 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,753 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,755 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,758 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,760 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,763 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,766 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:32,769 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,771 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,774 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,776 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,779 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,782 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,785 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,788 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,790 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,793 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,796 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,798 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,801 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,803 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,806 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,808 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,811 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,813 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,816 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,818 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,821 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,823 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,826 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,828 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,831 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,833 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,836 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,839 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,841 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,844 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,846 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,849 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,852 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,854 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,857 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,859 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,862 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,864 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,867 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,870 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,872 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,875 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,877 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,880 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,882 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,885 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,888 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,890 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,893 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,895 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,898 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,900 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,903 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,906 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,908 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,911 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,914 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,916 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,919 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,922 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,924 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,927 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:32,930 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,933 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,935 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,938 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,941 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,943 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,946 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,949 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,951 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,954 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,957 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,960 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,962 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,965 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,967 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,970 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,972 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,975 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,977 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,980 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,982 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,985 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,988 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,990 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,993 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,995 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:32,997 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,000 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,003 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,005 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,008 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,010 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,013 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,015 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,018 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,020 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,023 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,025 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,028 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,030 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,033 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,035 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,038 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,040 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,043 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,046 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,048 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,051 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,053 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,056 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,058 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,061 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,063 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,066 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,068 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,071 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,073 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,076 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,079 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,081 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,083 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,086 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:33,089 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,091 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,094 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,096 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,099 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,101 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,104 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,107 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,109 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,112 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,114 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,117 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,119 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,122 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,124 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,127 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,129 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,132 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,134 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,137 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,139 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,142 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,144 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,146 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,149 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,151 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,154 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,156 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,159 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,161 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,164 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,166 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,169 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,171 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,174 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,176 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,178 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,181 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,183 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,186 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,188 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,191 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,193 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,196 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,198 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,201 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,203 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,206 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,208 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,211 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,213 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,216 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,218 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,220 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,223 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,225 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,228 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,230 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,233 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,235 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,238 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,240 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:33,243 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,245 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,248 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,250 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,253 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,256 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,258 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,261 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,263 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,266 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,268 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,271 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,273 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,276 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,278 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,280 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,283 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,286 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,288 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,291 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,294 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,296 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,299 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,301 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,304 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,306 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,309 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,311 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,314 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,317 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,319 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,322 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,324 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,327 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,329 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,332 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,335 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,337 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,340 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,342 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,345 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,347 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,350 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,352 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,355 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,357 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,360 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,363 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,365 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,368 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,370 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,373 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,375 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,378 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,380 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,383 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,386 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,388 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,391 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,393 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,396 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,398 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:33,401 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,403 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,406 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,408 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,411 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,413 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,416 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,418 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,421 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,423 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,426 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,428 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,431 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,433 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,436 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,438 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,441 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,443 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,446 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,448 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,451 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,453 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,456 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,458 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,461 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,463 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,466 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,468 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,471 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,473 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,476 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,478 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,481 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,483 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,486 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,488 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,491 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,493 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,496 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,498 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,501 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,504 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,506 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,509 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,511 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,514 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,517 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,519 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,522 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,524 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,527 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,530 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,533 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,535 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,538 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,540 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,543 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,545 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,548 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,550 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,553 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,556 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:33,558 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,561 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,563 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,566 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,569 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,572 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,575 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,577 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,580 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,582 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,585 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,588 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,590 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,593 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,595 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,598 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,600 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,603 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,605 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,608 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,610 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,613 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,615 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,618 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,620 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,623 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,625 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,628 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,630 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,633 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,635 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,638 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,640 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,643 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,646 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,648 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,651 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,653 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,656 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,658 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,661 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,663 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,666 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,668 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,671 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,673 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,676 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,678 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,681 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,683 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,686 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,688 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,691 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,693 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,696 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,699 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,702 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,704 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,707 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,709 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,712 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,714 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:33,717 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,720 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,722 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,725 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,728 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,730 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,733 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,735 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,738 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,740 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,743 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,746 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,748 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,750 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,753 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,755 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,758 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,760 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,763 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,765 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,768 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,770 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,773 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,775 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,778 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,781 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,783 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,786 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,788 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,791 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,793 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,796 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,799 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,801 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,803 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,806 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,808 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,811 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,813 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,816 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,818 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,821 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,823 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,826 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,828 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,831 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,833 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,836 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,838 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,841 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,843 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,846 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,848 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,851 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,853 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,856 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,858 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,861 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,863 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,866 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,868 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,871 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:33,873 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,876 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,879 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,881 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,884 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,886 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,889 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,891 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,894 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,896 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,899 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,902 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,905 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,908 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,911 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,913 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,916 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,918 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,921 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,923 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,926 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,928 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,931 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,933 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,936 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,938 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,941 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,944 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,946 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,949 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,952 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,954 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,957 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,959 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,962 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,964 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,967 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,969 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,972 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,974 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,977 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,980 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,982 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,985 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,988 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,991 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,994 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,997 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:33,999 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,002 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,004 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,007 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,010 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,012 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,015 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,018 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,020 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,023 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,026 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,028 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,031 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,033 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:34,036 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,039 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,041 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,044 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,046 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,049 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,052 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,056 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,060 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,062 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,065 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,068 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,070 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,073 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,077 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,081 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,083 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,086 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,088 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,091 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,093 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,096 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,098 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,101 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,103 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,106 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,108 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,111 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,113 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,116 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,118 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,121 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,124 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,126 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,129 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,131 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,134 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,137 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,139 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,142 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,144 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,147 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,149 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,151 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,154 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,157 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,159 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,162 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,164 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,167 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,169 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,172 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,174 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,177 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,179 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,182 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,185 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,187 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,190 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,192 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,195 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,197 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:34,200 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,203 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,205 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,207 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,209 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,211 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,213 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,216 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,218 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,220 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,222 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,224 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,226 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,228 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,230 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,232 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,234 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,236 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,239 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,242 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,244 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,246 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,248 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,250 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,253 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,255 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,257 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,259 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,261 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,264 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,266 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,268 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,270 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,272 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,274 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,277 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,279 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,281 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,283 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,286 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,288 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,290 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,292 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,294 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,296 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,299 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,301 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,303 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,305 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,307 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,310 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,312 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,314 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,317 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,319 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,321 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,323 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,325 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,327 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,329 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,332 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,334 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:34,336 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,339 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,341 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,343 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,345 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,348 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,350 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,352 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,355 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,357 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,359 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,362 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,364 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,367 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,369 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,371 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,373 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,376 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,378 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,380 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,383 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,385 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,387 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,390 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,392 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,394 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,396 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,398 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,401 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,403 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,405 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,407 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,410 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,412 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,414 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,417 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,419 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,421 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,424 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,426 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,428 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,431 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,433 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,436 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,438 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,440 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,443 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,445 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,448 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,450 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,453 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,456 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,458 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,461 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,463 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,466 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,468 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,470 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,473 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,475 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,477 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,479 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:34,481 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,483 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,486 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,488 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,490 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,492 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,495 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,497 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,499 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,501 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,503 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,506 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,508 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,510 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,512 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,515 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,517 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,519 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,521 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,523 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,526 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,528 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,531 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,533 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,535 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,538 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,540 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,542 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,544 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,547 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,549 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,551 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,554 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,556 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,558 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,560 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,562 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,565 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,568 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,570 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,572 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,575 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,577 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,579 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,581 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,583 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,586 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,588 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,590 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,593 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,595 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,597 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,599 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,602 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,604 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,606 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,609 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,611 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,613 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,616 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,618 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,620 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:34,623 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,625 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,627 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,630 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,632 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,635 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,637 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,639 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,642 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,644 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,647 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,649 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,652 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,654 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,657 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,660 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,662 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,664 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,667 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,669 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,672 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,674 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,677 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,679 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,682 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,684 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,687 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,689 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,691 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,694 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,696 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,698 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,701 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,703 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,706 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,709 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,711 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,713 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,716 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,718 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,720 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,723 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,725 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,727 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,730 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,732 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,734 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,737 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,739 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,742 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,744 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,746 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,748 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,750 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,752 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,755 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,757 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,759 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,761 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,763 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,765 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,768 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:34,770 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,772 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,774 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,776 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,779 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,781 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,784 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,786 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,788 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,791 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,793 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,796 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,798 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,801 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,803 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,805 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,808 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,810 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,812 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,814 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,817 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,819 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,821 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,823 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,826 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,828 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,830 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,833 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,835 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,837 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,840 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,842 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,844 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,847 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,849 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,851 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,854 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,856 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,858 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,861 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,863 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,865 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,867 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,870 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,872 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,874 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,876 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,878 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,881 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,883 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,886 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,888 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,890 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,892 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,895 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,897 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,899 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,901 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,903 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,906 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,908 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,910 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:34,912 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,915 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,917 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,920 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,922 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,924 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,926 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,929 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,931 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,934 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,936 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,938 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,940 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,943 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,945 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,947 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,949 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,952 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,954 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,956 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,958 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,961 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,963 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,965 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,968 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,970 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,972 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,975 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,977 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,979 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,982 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,984 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,986 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,988 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,990 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,993 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,995 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:34,997 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,000 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,002 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,004 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,007 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,009 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,011 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,014 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,016 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,018 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,020 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,023 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,025 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,027 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,030 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,032 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,034 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,037 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,039 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,041 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,043 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,046 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,048 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,050 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,052 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:35,055 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,057 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,059 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,061 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,064 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,066 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,068 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,071 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,073 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,075 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,078 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,080 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,082 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,085 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,087 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,090 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,092 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,095 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,097 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,099 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,102 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,104 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,106 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,108 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,111 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,113 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,115 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,117 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,119 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,121 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,124 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,126 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,128 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,130 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,132 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,135 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,137 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,139 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,142 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,144 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,146 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,149 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,151 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,153 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,156 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,158 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,160 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,162 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,164 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,167 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,169 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,171 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,173 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,175 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,178 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,180 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,182 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,185 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,187 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,189 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,192 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,194 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:35,197 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,199 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,201 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,203 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,206 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,208 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,210 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,213 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,215 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,217 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,219 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,221 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,224 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,226 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,228 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,230 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,232 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,235 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,237 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,239 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,241 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,243 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,246 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,248 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,251 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,253 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,256 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,258 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,260 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,262 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,265 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,267 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,269 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,272 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,274 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,276 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,279 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,281 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,283 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,285 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,287 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,289 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,291 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,294 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,296 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,298 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,300 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,303 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,305 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,307 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,310 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,312 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,314 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,316 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,319 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,321 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,323 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,325 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,328 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,330 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,332 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,334 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:35,337 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,339 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,341 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,343 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,345 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,347 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,349 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,351 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,353 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,355 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,357 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,360 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,362 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,364 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,366 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,368 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,371 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,373 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,375 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,377 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,379 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,382 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,384 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,386 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,388 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,390 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,392 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,395 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,397 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,399 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,401 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,403 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,405 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,407 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,409 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,412 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,414 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,416 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,418 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,421 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,423 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,425 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,428 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,430 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,432 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,435 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,437 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,439 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,442 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,444 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,447 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,449 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,451 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,453 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,455 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,457 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,459 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,462 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,464 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,466 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,468 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,470 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:35,473 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,475 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,477 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,480 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,482 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,484 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,487 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,489 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,491 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,493 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,496 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,498 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,500 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,503 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,505 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,507 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,510 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,512 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,514 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,517 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,519 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,521 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,523 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,526 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,528 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,530 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,533 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,535 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,537 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,540 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,542 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,544 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,546 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,549 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,551 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,553 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,555 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,558 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,560 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,562 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,565 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,567 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,569 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,571 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,574 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,576 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,578 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,580 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,583 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,585 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,587 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,589 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,592 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,594 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,596 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,598 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,600 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,603 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,605 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,607 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,610 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,612 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:35,615 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,617 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,619 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,622 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,624 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,626 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,628 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,631 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,633 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,635 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,637 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,640 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,642 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,644 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,646 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,649 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,651 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,653 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,655 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,658 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,660 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,663 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,665 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,668 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,670 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,673 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,675 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,678 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,680 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,683 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,685 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,688 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,690 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,692 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,695 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,697 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,700 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,702 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,704 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,706 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,709 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,711 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,713 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,715 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,718 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,720 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,722 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,724 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,726 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,728 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,731 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,733 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,735 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,737 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,739 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,742 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,744 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,746 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,749 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,751 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,753 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,755 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:35,758 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,760 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,762 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,764 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,766 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,768 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,771 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,773 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,775 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,778 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,780 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,782 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,784 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,787 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,789 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,792 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,794 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,796 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,799 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,801 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,804 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,806 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,808 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,811 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,813 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,815 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,818 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,820 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,822 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,824 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,827 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,829 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,831 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,834 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,836 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,838 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,841 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,843 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,845 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,848 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,850 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,853 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,855 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,858 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,860 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,863 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,865 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,867 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,870 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,872 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,874 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,877 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,879 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,881 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,883 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,886 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,888 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,890 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,892 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,894 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,897 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,899 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:35,901 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,903 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,906 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,908 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,910 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,912 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,915 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,917 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,919 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,921 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,923 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,926 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,928 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,930 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,932 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,934 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,936 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,939 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,941 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,943 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,945 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,948 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,950 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,952 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,955 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,957 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,959 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,961 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,964 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,966 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,968 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,971 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,973 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,975 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,978 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,980 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,982 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,985 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,987 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,989 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,991 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,994 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,996 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:35,998 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,000 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,003 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,005 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,008 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,010 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,012 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,015 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,017 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,020 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,022 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,024 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,027 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,029 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,032 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,034 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,037 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,039 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,041 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:36,044 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,046 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,049 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,051 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,053 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,056 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,058 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,061 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,063 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,065 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,068 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,070 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,072 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,075 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,077 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,079 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,081 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,084 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,086 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,088 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,091 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,093 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,095 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,097 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,099 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,102 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,104 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,106 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,108 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,110 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,113 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,115 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,117 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,119 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,122 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,124 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,126 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,128 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,130 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,133 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,135 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,137 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,139 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,141 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,143 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,146 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,148 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,150 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,153 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,155 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,157 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,159 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,162 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,164 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,166 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,168 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,170 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,172 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,174 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,177 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,179 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,181 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:36,184 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,186 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,188 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,190 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,192 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,195 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,197 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,199 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,202 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,204 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,206 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,208 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,211 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,213 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,216 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,218 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,220 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,222 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,224 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,227 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,229 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,231 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,233 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,236 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,238 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,240 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,242 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,244 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,247 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,249 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,251 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,253 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,256 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,258 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,260 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,263 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,265 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,267 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,270 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,272 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,274 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,277 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,279 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,281 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,284 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,286 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,288 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,290 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,292 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,295 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,297 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,299 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,301 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,304 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,306 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,308 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,310 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,312 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,314 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,317 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,320 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,323 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:36,325 creating build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,326 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,329 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,331 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,333 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,336 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,338 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,341 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,344 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,346 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,349 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,351 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,354 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,356 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,359 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,361 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,364 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,366 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,369 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,372 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,374 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,377 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,380 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,383 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,386 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,388 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,391 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,394 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,396 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,399 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,401 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,404 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,407 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,409 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,412 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,414 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,417 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,419 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,422 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,424 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,426 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,429 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,432 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,434 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,437 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,440 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,442 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,444 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,447 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,450 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,452 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,455 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,458 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,461 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,463 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,466 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,469 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,471 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,474 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:36,476 creating build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,477 copying lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,480 copying lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,482 copying lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,484 copying lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,486 copying lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,488 copying lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,490 copying lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,493 copying lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,495 copying lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,497 copying lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,499 copying lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,501 copying lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,503 copying lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,505 copying lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,507 copying lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,509 copying lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,511 copying lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,513 copying lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,515 copying lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,517 copying lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,520 copying lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,522 copying lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,524 copying lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,526 copying lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,528 copying lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,530 copying lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,533 copying lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,535 copying lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,537 copying lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,540 copying lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,542 copying lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,544 copying lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,547 copying lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,549 copying lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,551 copying lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,554 copying lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,556 copying lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,558 copying lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,561 copying lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,563 copying lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,565 copying lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,568 copying lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,570 copying lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,572 copying lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,574 copying lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,577 copying lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,579 copying lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,582 copying lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,584 copying lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,586 copying lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,588 copying lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,591 copying lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,593 copying lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,595 copying lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,597 copying lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,600 copying lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,602 copying lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,605 copying lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,607 copying lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,609 copying lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,612 copying lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,614 copying lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:36,616 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,619 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,621 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,623 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,626 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,628 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,630 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,632 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,635 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,637 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,639 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,641 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,643 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,646 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,648 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,650 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,652 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,655 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,657 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,659 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,661 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,664 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,666 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,668 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,671 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,673 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,675 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,678 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,680 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,682 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,684 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,687 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,689 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,691 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,693 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,696 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,698 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,700 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,702 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,705 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,707 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,709 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,712 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,714 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,716 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,719 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,721 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,723 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,725 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,727 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,729 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,732 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,734 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,736 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,739 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,741 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,743 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,746 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:36,748 creating build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,749 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,752 copying lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,754 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,756 copying lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,759 copying lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,761 copying lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,763 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,766 copying lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,768 copying lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,770 copying lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,773 copying lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,775 copying lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,777 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,780 copying lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,782 copying lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,784 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,787 copying lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,789 copying lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,792 copying lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,795 copying lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,798 copying lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,800 copying lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,803 copying lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,805 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,807 copying lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,810 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,812 copying lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,815 copying lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,817 copying lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,820 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,822 copying lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,825 copying lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,828 copying lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,830 copying lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,832 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,834 copying lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,837 copying lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,839 copying lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,842 copying lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,844 copying lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,846 copying lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,848 copying lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,851 copying lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,853 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,856 copying lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,858 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,860 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,862 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,865 copying lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,867 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,870 copying lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,872 copying lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,875 copying lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,877 copying lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,880 copying lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,882 copying lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,884 copying lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,887 copying lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:36,889 creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,891 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,893 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,896 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,898 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,901 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,903 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,905 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,907 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,909 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,912 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,914 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,916 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,918 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,921 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,923 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,925 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,927 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,930 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,932 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,935 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,937 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,940 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,942 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,944 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,947 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,949 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,952 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,955 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,958 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,960 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,962 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,965 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,967 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,969 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,972 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,974 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,977 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,979 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,981 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,983 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,986 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,988 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,991 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,993 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,996 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:36,999 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,001 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,004 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,007 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,009 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,012 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,015 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,018 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,021 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,024 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,026 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,029 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,032 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:37,035 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,037 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,040 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,042 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,045 copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,048 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,050 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,053 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,055 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,058 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,060 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,063 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,065 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,069 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,071 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,074 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,076 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,079 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,082 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,085 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,087 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,090 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,093 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,095 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,098 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,101 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,103 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,106 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,109 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,112 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,114 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,117 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,120 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,123 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,125 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,128 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,131 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,133 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,136 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,139 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,142 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,145 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,148 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,150 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,153 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,155 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,158 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,160 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,162 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,164 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,167 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,169 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,171 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,173 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,176 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,178 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,181 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,183 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:37,185 creating build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,186 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,189 copying lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,191 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,194 copying lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,196 copying lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,198 copying lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,201 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,203 copying lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,205 copying lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,208 copying lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,210 copying lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,212 copying lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,214 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,217 copying lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,219 copying lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,221 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,223 copying lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,225 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,228 copying lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,230 copying lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,232 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,234 copying lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,236 copying lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,238 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,240 copying lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,242 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,245 copying lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,247 copying lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,249 copying lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,252 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,254 copying lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,256 copying lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,258 copying lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,261 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,263 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,265 copying lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,267 copying lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,269 copying lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,272 copying lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,274 copying lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,276 copying lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,278 copying lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,280 copying lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,283 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,285 copying lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,287 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,290 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,292 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,294 copying lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,296 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,298 copying lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,300 copying lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,302 copying lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,305 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,307 copying lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,309 copying lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,311 copying lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,313 copying lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:37,315 creating build/lib/lm_eval/tasks/triviaqa 2026-02-14T10:25:37,316 copying lm_eval/tasks/triviaqa/default.yaml -> build/lib/lm_eval/tasks/triviaqa 2026-02-14T10:25:37,318 creating build/lib/lm_eval/tasks/mmlu-redux-spanish 2026-02-14T10:25:37,319 copying lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish 2026-02-14T10:25:37,321 creating build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,322 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,325 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,327 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,329 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,332 copying lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,334 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,336 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,338 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,340 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,343 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,345 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,347 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,349 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,352 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,355 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,358 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,360 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,362 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,364 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,366 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,368 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,370 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,372 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,375 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,377 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,380 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,383 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,385 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,388 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,390 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,392 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,394 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,397 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,399 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,402 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,405 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,408 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,410 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,412 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,414 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,417 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,419 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,421 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,423 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,425 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,427 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,430 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,433 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,437 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,439 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,441 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,443 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,445 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,448 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,450 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,452 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,455 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,459 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:37,461 copying lm_eval/tasks/xcopa/default_ta.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,464 copying lm_eval/tasks/xcopa/default_tr.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,466 copying lm_eval/tasks/xcopa/default_et.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,469 copying lm_eval/tasks/xcopa/default_th.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,471 copying lm_eval/tasks/xcopa/default_vi.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,473 copying lm_eval/tasks/xcopa/default_id.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,476 copying lm_eval/tasks/xcopa/default_sw.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,479 copying lm_eval/tasks/xcopa/default_zh.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,481 copying lm_eval/tasks/xcopa/default_qu.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,483 copying lm_eval/tasks/xcopa/default_it.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,486 copying lm_eval/tasks/xcopa/_xcopa.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,488 copying lm_eval/tasks/xcopa/default_ht.yaml -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:37,492 copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:37,494 copying lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:37,496 copying lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:37,498 copying lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:37,500 copying lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:37,503 copying lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:37,505 copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:37,507 copying lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:37,509 copying lm_eval/tasks/logiqa/logiqa.yaml -> build/lib/lm_eval/tasks/logiqa 2026-02-14T10:25:37,512 copying lm_eval/tasks/icelandic_winogrande/default.yaml -> build/lib/lm_eval/tasks/icelandic_winogrande 2026-02-14T10:25:37,515 copying lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/lib/lm_eval/tasks/realtoxicityprompts 2026-02-14T10:25:37,517 creating build/lib/lm_eval/tasks/arc 2026-02-14T10:25:37,518 copying lm_eval/tasks/arc/arc_challenge.yaml -> build/lib/lm_eval/tasks/arc 2026-02-14T10:25:37,521 copying lm_eval/tasks/arc/arc_challenge_chat.yaml -> build/lib/lm_eval/tasks/arc 2026-02-14T10:25:37,523 copying lm_eval/tasks/arc/arc_easy.yaml -> build/lib/lm_eval/tasks/arc 2026-02-14T10:25:37,525 copying lm_eval/tasks/darijammlu/darijammlu_physics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,527 copying lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,529 copying lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,531 copying lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,533 copying lm_eval/tasks/darijammlu/darijammlu_civics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,536 copying lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,539 copying lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,542 copying lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,545 copying lm_eval/tasks/darijammlu/darijammlu_political_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,547 copying lm_eval/tasks/darijammlu/darijammlu_accounting.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,549 copying lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,551 copying lm_eval/tasks/darijammlu/darijammlu_sociology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,554 copying lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,556 copying lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,558 copying lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,560 copying lm_eval/tasks/darijammlu/darijammlu_social_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,562 copying lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,565 copying lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,569 copying lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,572 copying lm_eval/tasks/darijammlu/_darijammlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,574 copying lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,577 copying lm_eval/tasks/darijammlu/darijammlu_international_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,579 copying lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,581 copying lm_eval/tasks/darijammlu/darijammlu_math.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,583 copying lm_eval/tasks/darijammlu/darijammlu_management.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,586 copying lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,588 copying lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,590 copying lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,594 copying lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,597 copying lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,599 copying lm_eval/tasks/darijammlu/darijammlu_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,602 copying lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,604 copying lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,606 copying lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,609 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,611 copying lm_eval/tasks/darijammlu/darijammlu_biology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,613 copying lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,616 copying lm_eval/tasks/darijammlu/darijammlu_marketing.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,619 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,622 copying lm_eval/tasks/darijammlu/darijammlu_geography.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,624 copying lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,627 copying lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,630 copying lm_eval/tasks/darijammlu/darijammlu_economics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,632 copying lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,634 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,637 copying lm_eval/tasks/darijammlu/darijammlu_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,639 copying lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:37,642 copying lm_eval/tasks/histoires_morales/histoires_morales.yaml -> build/lib/lm_eval/tasks/histoires_morales 2026-02-14T10:25:37,646 copying lm_eval/tasks/slr_bench/slr_bench_group.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-02-14T10:25:37,649 copying lm_eval/tasks/slr_bench/slr_bench_hard.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-02-14T10:25:37,651 copying lm_eval/tasks/slr_bench/slr_bench_basic.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-02-14T10:25:37,653 copying lm_eval/tasks/slr_bench/slr_bench_easy.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-02-14T10:25:37,656 copying lm_eval/tasks/slr_bench/slr_bench_all.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-02-14T10:25:37,658 copying lm_eval/tasks/slr_bench/slr_bench_medium.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-02-14T10:25:37,661 copying lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml -> build/lib/lm_eval/tasks/med_text_classification 2026-02-14T10:25:37,663 copying lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml -> build/lib/lm_eval/tasks/med_text_classification 2026-02-14T10:25:37,666 creating build/lib/lm_eval/tasks/benchmarks 2026-02-14T10:25:37,667 copying lm_eval/tasks/benchmarks/pythia.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-02-14T10:25:37,671 copying lm_eval/tasks/benchmarks/openllm.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-02-14T10:25:37,675 copying lm_eval/tasks/benchmarks/t0_eval.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-02-14T10:25:37,677 copying lm_eval/tasks/benchmarks/minerva_math.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-02-14T10:25:37,679 creating build/lib/lm_eval/tasks/benchmarks/flan 2026-02-14T10:25:37,680 copying lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2026-02-14T10:25:37,683 copying lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2026-02-14T10:25:37,686 creating build/lib/lm_eval/tasks/benchmarks/multimedqa 2026-02-14T10:25:37,687 copying lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/lib/lm_eval/tasks/benchmarks/multimedqa 2026-02-14T10:25:37,690 copying lm_eval/tasks/eus_reading/eus_reading.yaml -> build/lib/lm_eval/tasks/eus_reading 2026-02-14T10:25:37,692 copying lm_eval/tasks/medmcqa/medmcqa.yaml -> build/lib/lm_eval/tasks/medmcqa 2026-02-14T10:25:37,696 copying lm_eval/tasks/click/click.yaml -> build/lib/lm_eval/tasks/click 2026-02-14T10:25:37,700 copying lm_eval/tasks/click/click_cul/click_cul_society.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:37,703 copying lm_eval/tasks/click/click_cul/click_cul_politics.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:37,705 copying lm_eval/tasks/click/click_cul/_click_cul.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:37,708 copying lm_eval/tasks/click/click_cul/click_cul_geography.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:37,710 copying lm_eval/tasks/click/click_cul/click_cul_history.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:37,712 copying lm_eval/tasks/click/click_cul/click_cul_economy.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:37,714 copying lm_eval/tasks/click/click_cul/click_cul_law.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:37,717 copying lm_eval/tasks/click/click_cul/click_cul_tradition.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:37,720 copying lm_eval/tasks/click/click_cul/click_cul_kpop.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:37,723 copying lm_eval/tasks/click/click_lang/_click_lang.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-02-14T10:25:37,726 copying lm_eval/tasks/click/click_lang/click_lang_grammar.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-02-14T10:25:37,729 copying lm_eval/tasks/click/click_lang/click_lang_text.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-02-14T10:25:37,731 copying lm_eval/tasks/click/click_lang/click_lang_function.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-02-14T10:25:37,733 creating build/lib/lm_eval/tasks/unscramble 2026-02-14T10:25:37,734 copying lm_eval/tasks/unscramble/reversed_words.yaml -> build/lib/lm_eval/tasks/unscramble 2026-02-14T10:25:37,736 copying lm_eval/tasks/unscramble/random_insertion.yaml -> build/lib/lm_eval/tasks/unscramble 2026-02-14T10:25:37,739 copying lm_eval/tasks/unscramble/cycle_letters.yaml -> build/lib/lm_eval/tasks/unscramble 2026-02-14T10:25:37,741 copying lm_eval/tasks/unscramble/anagrams1.yaml -> build/lib/lm_eval/tasks/unscramble 2026-02-14T10:25:37,743 copying lm_eval/tasks/unscramble/anagrams2.yaml -> build/lib/lm_eval/tasks/unscramble 2026-02-14T10:25:37,746 copying lm_eval/tasks/medqa/medqa.yaml -> build/lib/lm_eval/tasks/medqa 2026-02-14T10:25:37,749 copying lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,752 copying lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,755 copying lm_eval/tasks/paloma/paloma_gab.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,758 copying lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,760 copying lm_eval/tasks/paloma/paloma_mc4.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,762 copying lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,764 copying lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,767 copying lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,769 copying lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,771 copying lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,774 copying lm_eval/tasks/paloma/paloma_ptb.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,776 copying lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,779 copying lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,782 copying lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,784 copying lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,787 copying lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:37,789 creating build/lib/lm_eval/tasks/commonsense_qa 2026-02-14T10:25:37,790 copying lm_eval/tasks/commonsense_qa/default.yaml -> build/lib/lm_eval/tasks/commonsense_qa 2026-02-14T10:25:37,793 copying lm_eval/tasks/darijahellaswag/darijahellaswag.yaml -> build/lib/lm_eval/tasks/darijahellaswag 2026-02-14T10:25:37,795 copying lm_eval/tasks/cabbq/cabbq_disability_status.yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:37,797 copying lm_eval/tasks/cabbq/cabbq_ses.yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:37,800 copying lm_eval/tasks/cabbq/cabbq_gender.yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:37,802 copying lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:37,804 copying lm_eval/tasks/cabbq/cabbq_spanish_region.yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:37,806 copying lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:37,809 copying lm_eval/tasks/cabbq/cabbq.yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:37,811 copying lm_eval/tasks/cabbq/cabbq_age.yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:37,813 copying lm_eval/tasks/cabbq/cabbq_religion.yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:37,815 copying lm_eval/tasks/cabbq/cabbq_nationality.yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:37,818 copying lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:37,820 copying lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,822 copying lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,825 copying lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,827 copying lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,829 copying lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,831 copying lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,834 copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,836 copying lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,838 copying lm_eval/tasks/metabench/metabench_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,840 copying lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,842 copying lm_eval/tasks/metabench/metabench.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,844 copying lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,847 copying lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,849 copying lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,851 copying lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,853 copying lm_eval/tasks/metabench/metabench_arc.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,856 copying lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,858 copying lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,860 copying lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,862 copying lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,865 copying lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,867 copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,869 copying lm_eval/tasks/metabench/metabench_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,871 copying lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,874 copying lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,876 copying lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:37,879 creating build/lib/lm_eval/tasks/pile_10k 2026-02-14T10:25:37,880 copying lm_eval/tasks/pile_10k/pile_10k.yaml -> build/lib/lm_eval/tasks/pile_10k 2026-02-14T10:25:37,883 copying lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-02-14T10:25:37,885 copying lm_eval/tasks/minerva_math/minerva_math500.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-02-14T10:25:37,887 copying lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-02-14T10:25:37,890 copying lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-02-14T10:25:37,892 copying lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-02-14T10:25:37,895 copying lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-02-14T10:25:37,898 copying lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-02-14T10:25:37,901 copying lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-02-14T10:25:37,904 creating build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,905 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,908 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,911 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,913 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,917 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,920 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,922 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,925 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,928 copying lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,931 copying lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,934 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,937 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,940 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,943 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,946 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,949 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:37,951 copying lm_eval/tasks/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/ifeval 2026-02-14T10:25:37,954 copying lm_eval/tasks/ifeval/multilingual/ifeval_ca.yaml -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-02-14T10:25:37,958 copying lm_eval/tasks/ifeval/multilingual/ifeval_es.yaml -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-02-14T10:25:37,960 creating build/lib/lm_eval/tasks/mc_taco 2026-02-14T10:25:37,961 copying lm_eval/tasks/mc_taco/default.yaml -> build/lib/lm_eval/tasks/mc_taco 2026-02-14T10:25:37,964 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:37,967 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:37,970 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:37,973 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:37,976 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:37,979 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:37,982 copying lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:37,985 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:37,988 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:37,990 creating build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:37,992 copying lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:37,994 copying lm_eval/tasks/xstorycloze/default_es.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:37,996 copying lm_eval/tasks/xstorycloze/default_ru.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:37,999 copying lm_eval/tasks/xstorycloze/default_eu.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:38,001 copying lm_eval/tasks/xstorycloze/default_en.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:38,003 copying lm_eval/tasks/xstorycloze/default_id.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:38,005 copying lm_eval/tasks/xstorycloze/default_sw.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:38,008 copying lm_eval/tasks/xstorycloze/default_ar.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:38,010 copying lm_eval/tasks/xstorycloze/default_zh.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:38,012 copying lm_eval/tasks/xstorycloze/default_te.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:38,014 copying lm_eval/tasks/xstorycloze/default_hi.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:38,017 copying lm_eval/tasks/xstorycloze/default_my.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:38,019 copying lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/lib/lm_eval/tasks/scrolls 2026-02-14T10:25:38,021 copying lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/lib/lm_eval/tasks/scrolls 2026-02-14T10:25:38,024 copying lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/lib/lm_eval/tasks/scrolls 2026-02-14T10:25:38,026 copying lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/lib/lm_eval/tasks/scrolls 2026-02-14T10:25:38,028 copying lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/lib/lm_eval/tasks/scrolls 2026-02-14T10:25:38,030 copying lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/lib/lm_eval/tasks/scrolls 2026-02-14T10:25:38,032 copying lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/lib/lm_eval/tasks/scrolls 2026-02-14T10:25:38,035 copying lm_eval/tasks/afrobench/afrobench-lite.yaml -> build/lib/lm_eval/tasks/afrobench 2026-02-14T10:25:38,037 copying lm_eval/tasks/afrobench/afrobench.yaml -> build/lib/lm_eval/tasks/afrobench 2026-02-14T10:25:38,040 copying lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti 2026-02-14T10:25:38,042 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:25:38,044 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:25:38,047 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:25:38,049 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:25:38,052 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:25:38,054 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:25:38,056 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:25:38,059 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:25:38,062 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:25:38,064 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:25:38,067 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:25:38,069 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:25:38,071 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:25:38,073 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:25:38,075 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:25:38,078 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:25:38,080 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:25:38,082 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:25:38,085 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:25:38,087 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:25:38,090 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:25:38,092 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:25:38,094 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:25:38,097 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:25:38,100 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:25:38,102 copying lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews 2026-02-14T10:25:38,105 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,108 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,110 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,112 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,114 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,117 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,119 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,122 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,124 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,127 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,129 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,131 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,133 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,135 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,138 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,140 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:38,142 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,144 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,147 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,149 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,152 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,155 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,157 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,160 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,162 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,164 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,167 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,169 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,171 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,174 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,177 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,179 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:38,181 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,183 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,185 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,188 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,190 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,192 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,194 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,197 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,199 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,201 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,203 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,206 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,208 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,210 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,212 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,215 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:38,217 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,219 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,222 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,224 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,226 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,229 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,231 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,233 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,236 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,238 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,240 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,243 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,245 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,248 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,250 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,252 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:38,255 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,257 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,259 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,262 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,264 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,266 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,269 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,271 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,273 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,275 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,278 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,280 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,283 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,286 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,288 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,291 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:38,293 copying lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-02-14T10:25:38,296 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:25:38,298 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:25:38,300 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:25:38,303 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:25:38,306 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:25:38,308 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:25:38,310 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:25:38,312 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:25:38,315 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:25:38,317 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:25:38,319 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:25:38,321 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:25:38,324 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:25:38,326 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:25:38,329 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:25:38,331 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:25:38,333 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:25:38,336 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:25:38,338 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:25:38,340 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:25:38,342 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:25:38,345 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:25:38,348 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:25:38,350 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:25:38,353 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:25:38,355 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:25:38,357 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:25:38,360 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:25:38,362 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:25:38,364 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:25:38,366 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:25:38,368 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:25:38,371 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:25:38,373 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:25:38,375 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:25:38,378 copying lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-02-14T10:25:38,380 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-02-14T10:25:38,381 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-02-14T10:25:38,384 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-02-14T10:25:38,386 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-02-14T10:25:38,388 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-02-14T10:25:38,389 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-02-14T10:25:38,391 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-02-14T10:25:38,394 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-02-14T10:25:38,396 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-02-14T10:25:38,397 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-02-14T10:25:38,399 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-02-14T10:25:38,402 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-02-14T10:25:38,404 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-02-14T10:25:38,406 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-02-14T10:25:38,408 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-02-14T10:25:38,410 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-02-14T10:25:38,412 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-02-14T10:25:38,413 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-02-14T10:25:38,417 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-02-14T10:25:38,419 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-02-14T10:25:38,422 copying lm_eval/tasks/afrobench/adr/afridiacritics.yaml -> build/lib/lm_eval/tasks/afrobench/adr 2026-02-14T10:25:38,424 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:25:38,425 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:25:38,427 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:25:38,429 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:25:38,431 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:25:38,433 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:25:38,435 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:25:38,436 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:25:38,439 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:25:38,441 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:25:38,443 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:25:38,445 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:25:38,447 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:25:38,448 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:25:38,452 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:25:38,454 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:25:38,456 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:25:38,459 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:25:38,461 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:25:38,462 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:25:38,464 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:25:38,467 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:25:38,469 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:25:38,471 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:25:38,473 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:25:38,475 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:25:38,478 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:25:38,480 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:25:38,483 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:25:38,485 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:25:38,487 copying lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner 2026-02-14T10:25:38,489 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,491 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,493 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,496 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,498 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,500 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,503 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,506 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,508 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,510 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,513 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,515 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,517 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,519 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,521 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,523 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,525 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,528 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,531 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,533 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:38,536 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,538 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,540 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,542 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,544 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,547 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,549 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,551 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,553 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,556 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,558 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,561 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,563 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,565 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,567 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,570 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,572 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,574 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,576 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,578 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:38,581 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,583 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,585 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,587 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,589 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,592 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,594 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,596 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,599 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,601 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,603 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,606 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,608 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,610 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,612 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,614 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,617 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,619 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,621 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,623 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:38,625 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,627 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,629 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,631 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,633 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,635 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,637 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,640 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,642 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,644 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,647 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,649 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,651 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,654 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,656 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,658 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,660 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,662 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,665 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,668 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:38,670 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,673 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,675 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,679 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,681 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,683 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,685 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,687 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,690 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,692 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,694 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,696 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,699 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,702 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,705 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,708 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,710 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,713 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,716 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,719 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:38,722 copying lm_eval/tasks/afrobench/naijarc/naijarc.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc 2026-02-14T10:25:38,725 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-02-14T10:25:38,726 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-02-14T10:25:38,729 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-02-14T10:25:38,732 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-02-14T10:25:38,735 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-02-14T10:25:38,736 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-02-14T10:25:38,740 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-02-14T10:25:38,742 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-02-14T10:25:38,745 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-02-14T10:25:38,747 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-02-14T10:25:38,750 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-02-14T10:25:38,752 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-02-14T10:25:38,755 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-02-14T10:25:38,756 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-02-14T10:25:38,759 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-02-14T10:25:38,762 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-02-14T10:25:38,766 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-02-14T10:25:38,768 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-02-14T10:25:38,771 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-02-14T10:25:38,774 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-02-14T10:25:38,777 copying lm_eval/tasks/afrobench/ntrex/ntrex.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex 2026-02-14T10:25:38,779 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,781 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,784 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,787 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,790 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,793 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,796 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,799 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,801 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,803 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,806 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,808 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,810 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,814 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,817 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,819 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,821 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,823 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,825 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,827 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,830 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,832 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,834 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,836 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,838 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,840 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,843 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,845 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,847 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,849 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,852 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,854 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,856 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:38,858 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,860 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,862 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,864 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,866 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,868 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,870 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,872 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,874 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,877 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,879 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,881 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,884 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,886 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,888 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,890 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,892 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,895 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,897 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,899 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,901 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,904 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,906 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,908 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,911 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,913 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,915 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,917 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,919 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,922 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,924 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,927 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,930 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:38,932 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,933 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,936 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,938 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,940 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,943 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,945 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,947 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,949 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,952 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,954 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,956 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,958 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,961 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,963 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,965 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,967 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,969 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,972 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,974 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,977 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,979 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,982 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,984 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,986 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,989 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,991 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,994 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,996 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:38,998 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:39,001 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:39,003 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:39,006 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:39,008 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,010 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,012 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,014 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,016 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,018 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,020 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,022 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,025 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,027 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,029 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,031 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,033 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,035 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,038 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,040 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,042 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,045 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,047 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,049 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,051 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,053 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,056 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,058 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,060 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,062 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,064 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,066 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,068 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,070 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,073 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,076 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,078 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:39,080 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,082 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,084 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,086 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,088 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,090 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,093 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,095 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,097 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,099 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,102 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,104 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,107 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,109 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,111 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,113 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,115 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,118 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,120 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,122 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,124 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,127 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,129 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,131 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,133 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,135 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,137 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,139 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,142 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,144 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,146 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,148 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,150 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:39,153 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,154 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,157 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,159 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,161 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,163 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,166 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,168 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,170 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,172 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,174 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,177 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,179 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,181 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,184 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,186 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,188 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,190 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,192 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,194 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,197 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,199 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,201 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,203 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,205 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,207 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,209 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,211 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,213 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,215 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,217 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,219 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,221 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:39,223 copying lm_eval/tasks/afrobench/salt/salt.yaml -> build/lib/lm_eval/tasks/afrobench/salt 2026-02-14T10:25:39,225 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,226 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,229 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,231 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,233 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,235 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,237 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,239 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,241 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,244 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,246 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,248 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,250 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,253 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,256 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:39,258 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,259 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,262 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,264 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,266 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,268 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,270 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,272 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,274 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,276 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,278 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,280 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,282 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,285 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,287 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:39,289 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,290 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,292 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,294 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,297 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,299 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,301 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,303 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,305 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,308 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,310 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,312 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,314 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,317 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,319 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:39,321 copying lm_eval/tasks/afrobench/flores/flores.yaml -> build/lib/lm_eval/tasks/afrobench/flores 2026-02-14T10:25:39,323 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,325 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,327 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,329 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,331 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,333 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,335 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,337 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,339 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,342 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,344 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,346 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,348 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,350 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,353 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,355 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,357 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,359 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,362 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,364 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,366 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,368 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,371 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,373 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,375 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,377 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,379 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,381 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,383 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,385 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,388 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,390 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,392 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,394 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,396 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,398 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,400 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,402 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,405 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,407 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,409 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,411 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,414 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,416 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,418 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,420 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,422 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,425 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,427 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,429 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,431 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,433 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,435 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,437 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,440 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,442 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,445 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,447 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,449 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,451 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,453 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,456 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,458 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:39,460 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,461 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,464 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,466 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,468 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,471 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,473 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,475 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,477 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,479 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,481 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,485 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,487 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,489 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,491 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,493 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,496 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,498 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,500 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,502 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,505 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,507 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,509 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,511 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,513 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,516 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,518 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,520 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,522 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,524 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,527 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,529 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,531 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,534 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,536 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,538 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,540 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,542 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,544 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,546 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,549 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,551 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,553 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,555 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,558 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,560 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,562 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,564 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,567 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,570 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,572 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,574 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,576 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,578 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,580 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,582 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,584 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,586 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,589 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,591 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,593 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,595 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,598 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:39,600 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,601 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,604 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,606 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,608 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,611 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,613 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,615 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,617 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,619 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,621 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,623 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,626 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,628 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,630 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,632 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,635 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,637 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,639 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,641 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,643 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,645 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,648 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,650 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,652 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,655 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,657 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,659 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,661 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,664 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,666 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,668 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,670 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,672 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,674 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,676 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,679 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,681 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,683 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,685 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,688 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,691 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,693 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,695 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,698 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,700 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,702 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,705 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,707 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,710 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,712 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,714 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,716 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,718 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,720 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,722 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,725 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,727 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,729 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,732 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,734 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,736 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,738 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:39,740 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,741 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,743 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,746 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,748 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,750 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,753 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,755 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,757 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,759 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,761 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,763 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,765 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,767 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,770 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,772 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,774 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,777 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,779 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,781 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,783 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,785 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,788 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,790 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,792 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,795 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,797 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,799 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,801 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,803 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,806 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,808 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,810 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,812 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,814 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,817 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,819 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,821 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,823 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,825 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,827 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,829 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,832 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,834 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,836 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,838 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,840 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,842 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,845 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,847 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,849 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,851 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,853 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,856 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,858 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,860 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,862 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,864 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,866 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,868 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,871 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,873 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,875 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:39,877 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,878 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,881 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,883 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,885 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,887 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,889 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,892 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,894 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,896 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,898 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,900 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,903 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,905 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,907 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,909 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,911 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,913 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,915 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,917 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,919 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,921 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,923 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,925 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,928 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,930 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,932 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,934 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,936 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,938 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,940 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,943 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,945 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,947 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,949 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,952 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,954 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,956 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,958 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,960 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,962 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,964 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,966 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,968 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,970 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,972 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,974 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,976 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,979 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,981 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,983 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,987 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,991 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,996 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:39,999 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:40,001 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:40,004 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:40,006 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:40,008 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:40,010 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:40,013 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:40,016 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:40,019 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:40,021 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,022 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,025 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,027 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,029 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,031 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,033 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,035 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,038 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,041 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,043 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,046 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,048 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,050 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,052 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,054 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,057 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,059 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,061 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,063 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,065 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,067 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,069 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,072 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,075 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,078 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,080 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,082 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,084 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,086 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,089 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,091 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,093 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,095 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,098 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,100 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,102 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,104 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,106 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,109 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,112 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,115 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,118 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,120 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,122 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,124 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,127 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,129 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,131 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,133 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,136 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,138 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,140 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,142 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,145 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,148 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,150 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,152 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,155 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,157 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,159 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,161 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,164 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:40,167 copying lm_eval/tasks/afrobench/belebele/belebele.yaml -> build/lib/lm_eval/tasks/afrobench/belebele 2026-02-14T10:25:40,169 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,170 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,172 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,175 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,177 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,180 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,182 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,184 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,187 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,189 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,192 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,194 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,197 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,199 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,201 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,204 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,206 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,209 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,211 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,214 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,217 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,219 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,222 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,224 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,227 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,229 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,232 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,234 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,237 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,239 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,242 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,244 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:40,246 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,247 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,250 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,253 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,255 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,258 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,260 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,263 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,265 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,267 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,270 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,272 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,275 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,277 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,279 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,282 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,284 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,287 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,289 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,292 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,294 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,297 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,299 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,302 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,304 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,307 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,309 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,312 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,314 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,316 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,319 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,322 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:40,324 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,325 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,328 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,330 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,332 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,335 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,337 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,340 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,342 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,344 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,347 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,349 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,353 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,355 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,357 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,360 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,362 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,365 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,367 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,370 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,372 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,374 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,377 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,379 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,382 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,384 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,387 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,389 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,392 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,394 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,397 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,399 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:40,401 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,403 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,405 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,408 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,410 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,413 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,415 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,418 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,420 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,422 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,425 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,427 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,429 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,432 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,434 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,436 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,438 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,441 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,443 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,445 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,447 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,449 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,451 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,453 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,456 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,458 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,460 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,462 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,464 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,468 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,472 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,474 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:40,476 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,477 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,480 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,482 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,484 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,486 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,489 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,491 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,493 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,495 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,497 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,499 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,501 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,503 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,506 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,508 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,510 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,513 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,515 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,518 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,520 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,522 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,524 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,527 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,529 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,531 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,533 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,536 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,538 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,541 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,543 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,545 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:40,548 copying lm_eval/tasks/afrobench/mafand/mafand.yaml -> build/lib/lm_eval/tasks/afrobench/mafand 2026-02-14T10:25:40,550 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,552 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,555 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,557 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,559 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,561 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,563 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,565 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,568 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,570 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,572 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,574 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,576 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,579 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,581 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,583 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,585 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,587 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,590 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,592 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,595 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:40,597 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,599 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,601 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,604 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,606 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,608 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,611 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,614 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,616 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,618 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,620 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,623 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,625 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,627 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,630 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,632 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,635 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,637 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,640 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,642 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,645 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:40,647 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,650 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,652 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,655 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,657 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,659 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,661 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,663 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,666 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,668 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,670 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,672 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,675 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,677 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,679 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,681 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,684 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,686 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,688 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,690 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,693 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:40,695 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,697 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,700 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,703 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,706 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,710 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,714 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,717 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,721 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,723 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,725 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,728 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,730 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,733 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,735 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,737 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,739 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,742 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,744 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,747 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,967 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:40,970 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:40,973 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:40,976 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:40,979 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:40,982 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:40,985 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:40,988 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:40,991 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:40,994 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:40,997 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,001 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,004 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,007 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,010 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,012 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,015 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,018 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,021 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,024 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,027 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,030 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:41,033 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,036 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,039 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,042 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,045 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,048 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,051 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,054 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,056 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,058 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,060 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,062 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,064 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,067 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,069 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,071 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,073 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,075 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,077 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,080 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,082 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:41,084 copying lm_eval/tasks/afrobench/injongointent/injongointent.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent 2026-02-14T10:25:41,086 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,089 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,091 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,093 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,095 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,098 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,100 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,103 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,105 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,108 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,110 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,112 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,114 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,116 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,119 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,121 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,123 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:41,126 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,128 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,130 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,132 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,134 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,137 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,139 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,142 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,144 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,147 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,149 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,152 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,154 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,156 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,158 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,161 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,163 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:41,165 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,168 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,170 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,172 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,174 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,176 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,178 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,181 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,183 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,185 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,188 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,190 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,193 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,195 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,197 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,200 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,202 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:41,204 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,207 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,209 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,211 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,214 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,216 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,218 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,221 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,223 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,226 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,229 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,232 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,236 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,239 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,241 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,243 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,246 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:41,250 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,252 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,255 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,257 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,259 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,262 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,265 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,269 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,272 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,274 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,276 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,279 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,281 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,283 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,286 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,288 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,290 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:41,293 copying lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-02-14T10:25:41,295 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,297 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,299 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,301 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,303 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,306 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,308 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,310 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,312 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,314 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,317 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,319 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,321 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,323 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:41,326 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,328 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,331 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,333 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,335 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,338 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,340 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,342 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,344 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,347 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,349 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,352 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,354 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,356 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:41,358 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,361 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,363 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,365 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,367 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,369 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,371 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,373 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,376 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,378 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,380 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,382 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,384 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,387 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:41,389 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,391 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,393 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,396 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,398 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,401 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,403 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,405 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,407 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,410 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,412 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,414 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,416 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,418 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:41,421 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,423 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,425 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,427 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,429 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,432 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,434 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,436 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,438 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,440 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,443 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,445 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,447 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,449 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:41,452 copying lm_eval/tasks/afrobench/sib/sib.yaml -> build/lib/lm_eval/tasks/afrobench/sib 2026-02-14T10:25:41,454 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,456 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,458 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,460 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,463 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,465 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,467 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,469 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,471 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,474 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,476 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,478 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,480 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,482 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,485 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,487 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,489 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,491 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,493 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,495 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,497 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,500 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,503 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,505 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,507 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,510 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,512 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,514 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,516 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,518 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,521 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,523 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,525 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,527 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,529 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,532 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,534 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,536 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,538 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,540 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,542 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,546 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,548 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,550 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,552 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,554 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,557 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,559 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,561 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,563 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,565 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,567 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,570 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,572 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,574 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,576 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:41,578 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,581 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,583 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,585 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,588 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,591 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,593 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,596 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,598 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,600 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,602 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,605 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,607 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,609 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,612 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,614 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,617 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,619 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,621 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,623 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,626 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,628 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,630 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,632 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,634 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,636 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,639 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,641 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,643 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,645 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,648 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,650 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,652 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,655 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,657 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,660 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,662 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,664 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,667 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,669 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,671 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,673 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,676 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,678 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,681 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,683 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,686 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,688 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,690 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,693 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,696 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,698 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,700 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,702 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,705 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,707 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:41,709 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,711 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,713 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,716 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,718 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,720 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,724 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,726 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,728 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,731 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,733 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,735 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,737 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,739 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,742 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,744 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,746 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,748 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,751 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,753 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,755 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,758 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,760 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,762 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,764 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,766 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,768 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,771 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,774 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,776 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,778 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,781 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,783 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,785 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,787 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,789 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,792 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,794 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,796 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,798 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,800 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,802 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,805 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,807 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,809 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,812 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:41,814 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:42,036 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:42,038 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:42,040 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:42,043 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:42,046 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:42,048 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:42,050 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:42,052 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:42,054 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:42,057 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,059 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,061 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,063 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,065 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,067 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,070 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,072 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,074 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,076 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,078 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,080 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,083 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,085 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,087 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,089 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,092 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,094 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,096 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,099 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,101 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,103 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,105 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,108 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,110 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,112 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,114 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,116 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,118 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,121 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,123 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,125 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,128 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,130 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,132 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,134 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,136 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,139 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,141 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,143 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,145 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,147 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,150 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,152 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,154 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,156 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,159 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,161 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,163 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,165 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,167 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,170 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,172 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,174 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,176 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,179 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:42,181 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,184 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,186 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,188 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,190 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,192 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,195 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,197 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,199 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,201 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,203 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,205 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,207 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,210 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,212 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,214 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,216 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,218 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,221 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,223 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,225 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,227 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,229 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,231 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,234 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,236 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,238 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,240 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,242 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,244 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,247 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,249 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,251 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,253 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,255 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,257 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,259 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,262 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,264 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,266 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,268 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,270 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,272 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,274 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,276 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,278 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,280 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,283 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,285 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,287 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,289 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,291 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,293 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,296 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,298 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,300 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:42,302 copying lm_eval/tasks/afrobench/xlsum/xlsum.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum 2026-02-14T10:25:42,305 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,308 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,310 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,312 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,314 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,316 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,319 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,321 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,323 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,325 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,327 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,329 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:42,331 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,333 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,335 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,338 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,340 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,342 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,344 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,347 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,349 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,351 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,354 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,356 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:42,358 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,360 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,363 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,366 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,368 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,370 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,372 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,374 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,377 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,379 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,381 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,383 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:42,386 copying lm_eval/tasks/afrobench/afriqa/afriqa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa 2026-02-14T10:25:42,388 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:42,390 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:42,393 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:42,395 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:42,397 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:42,400 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:42,402 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:42,404 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:42,406 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:42,408 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:42,411 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:42,413 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:42,415 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:42,417 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:42,419 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:42,421 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:42,424 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:42,426 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:42,428 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:42,431 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:42,433 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:42,435 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:42,438 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:42,440 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:42,442 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:42,444 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:42,447 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:42,449 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:42,451 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:42,453 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:42,455 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:42,457 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:42,459 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:42,461 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:42,464 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:42,467 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:42,469 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:42,472 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:42,475 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:42,478 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:42,480 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:42,483 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:42,486 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:42,488 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:42,492 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:42,495 copying lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-02-14T10:25:42,498 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,501 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,504 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,507 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,510 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,513 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,516 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,518 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,521 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,524 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,527 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,529 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,532 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,535 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,538 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,540 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,543 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,546 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,549 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,552 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:42,555 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,558 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,561 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,564 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,566 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,568 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,571 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,573 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,575 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,578 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,580 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,582 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,584 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,587 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,589 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,592 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,595 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,597 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,599 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,602 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:42,604 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,606 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,608 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,611 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,613 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,616 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,618 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,620 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,623 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,625 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,628 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,630 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,633 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,635 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,638 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,641 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,659 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,661 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,663 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,665 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:42,668 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,670 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,673 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,675 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,677 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,680 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,682 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,684 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,686 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,689 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,691 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,693 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,695 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,698 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,700 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,702 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,705 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,708 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,710 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,712 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:42,739 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,741 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,743 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,746 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,748 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,750 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,753 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,755 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,757 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,759 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,761 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,764 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,766 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,768 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,770 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,772 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,775 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,777 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,780 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,782 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:42,784 copying lm_eval/tasks/ruler/niah_multikey_1.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,786 copying lm_eval/tasks/ruler/niah_multiquery.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,788 copying lm_eval/tasks/ruler/ruler.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,790 copying lm_eval/tasks/ruler/niah_single_2.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,793 copying lm_eval/tasks/ruler/niah_multikey_2.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,795 copying lm_eval/tasks/ruler/niah_multivalue.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,797 copying lm_eval/tasks/ruler/niah_single_3.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,799 copying lm_eval/tasks/ruler/niah_multikey_3.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,801 copying lm_eval/tasks/ruler/qa_hotpot.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,803 copying lm_eval/tasks/ruler/vt.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,805 copying lm_eval/tasks/ruler/fwe.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,808 copying lm_eval/tasks/ruler/qa_squad.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,810 copying lm_eval/tasks/ruler/cwe.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,812 copying lm_eval/tasks/ruler/niah_single_1.yaml -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:42,814 creating build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,816 copying lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,818 copying lm_eval/tasks/pile/pile_philpapers.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,820 copying lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,823 copying lm_eval/tasks/pile/pile_gutenberg.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,825 copying lm_eval/tasks/pile/pile_books3.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,827 copying lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,829 copying lm_eval/tasks/pile/pile_wikipedia.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,831 copying lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,833 copying lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,836 copying lm_eval/tasks/pile/pile_freelaw.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,838 copying lm_eval/tasks/pile/pile_stackexchange.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,840 copying lm_eval/tasks/pile/pile_github.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,843 copying lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,845 copying lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,847 copying lm_eval/tasks/pile/pile_europarl.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,850 copying lm_eval/tasks/pile/pile_pile-cc.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,852 copying lm_eval/tasks/pile/pile_uspto.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,854 copying lm_eval/tasks/pile/pile_enron.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,857 copying lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,859 copying lm_eval/tasks/pile/pile_hackernews.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,861 copying lm_eval/tasks/pile/pile_arxiv.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,863 copying lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:42,866 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,868 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,870 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,872 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,874 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,877 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,879 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,881 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,883 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,885 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,888 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,890 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,892 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,895 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,897 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,899 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,901 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,904 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:42,906 copying lm_eval/tasks/basqueglue/bhtc.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-02-14T10:25:42,908 copying lm_eval/tasks/basqueglue/vaxx.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-02-14T10:25:42,910 copying lm_eval/tasks/basqueglue/wic.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-02-14T10:25:42,912 copying lm_eval/tasks/basqueglue/qnli.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-02-14T10:25:42,915 copying lm_eval/tasks/basqueglue/coref.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-02-14T10:25:42,917 copying lm_eval/tasks/basqueglue/bec.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-02-14T10:25:42,919 copying lm_eval/tasks/global_piqa/prompted/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,921 copying lm_eval/tasks/global_piqa/prompted/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,923 copying lm_eval/tasks/global_piqa/prompted/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,925 copying lm_eval/tasks/global_piqa/prompted/bos_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,927 copying lm_eval/tasks/global_piqa/prompted/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,930 copying lm_eval/tasks/global_piqa/prompted/kaz_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,932 copying lm_eval/tasks/global_piqa/prompted/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,934 copying lm_eval/tasks/global_piqa/prompted/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,936 copying lm_eval/tasks/global_piqa/prompted/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,938 copying lm_eval/tasks/global_piqa/prompted/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,940 copying lm_eval/tasks/global_piqa/prompted/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,942 copying lm_eval/tasks/global_piqa/prompted/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,944 copying lm_eval/tasks/global_piqa/prompted/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,946 copying lm_eval/tasks/global_piqa/prompted/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,948 copying lm_eval/tasks/global_piqa/prompted/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,951 copying lm_eval/tasks/global_piqa/prompted/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,953 copying lm_eval/tasks/global_piqa/prompted/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,955 copying lm_eval/tasks/global_piqa/prompted/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,957 copying lm_eval/tasks/global_piqa/prompted/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,959 copying lm_eval/tasks/global_piqa/prompted/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,961 copying lm_eval/tasks/global_piqa/prompted/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,963 copying lm_eval/tasks/global_piqa/prompted/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,966 copying lm_eval/tasks/global_piqa/prompted/_global_piqa.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,968 copying lm_eval/tasks/global_piqa/prompted/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,970 copying lm_eval/tasks/global_piqa/prompted/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,972 copying lm_eval/tasks/global_piqa/prompted/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,974 copying lm_eval/tasks/global_piqa/prompted/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,977 copying lm_eval/tasks/global_piqa/prompted/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,979 copying lm_eval/tasks/global_piqa/prompted/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,981 copying lm_eval/tasks/global_piqa/prompted/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,983 copying lm_eval/tasks/global_piqa/prompted/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,985 copying lm_eval/tasks/global_piqa/prompted/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,987 copying lm_eval/tasks/global_piqa/prompted/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,989 copying lm_eval/tasks/global_piqa/prompted/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,991 copying lm_eval/tasks/global_piqa/prompted/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,993 copying lm_eval/tasks/global_piqa/prompted/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,995 copying lm_eval/tasks/global_piqa/prompted/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:42,997 copying lm_eval/tasks/global_piqa/prompted/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,000 copying lm_eval/tasks/global_piqa/prompted/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,002 copying lm_eval/tasks/global_piqa/prompted/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,004 copying lm_eval/tasks/global_piqa/prompted/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,006 copying lm_eval/tasks/global_piqa/prompted/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,008 copying lm_eval/tasks/global_piqa/prompted/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,011 copying lm_eval/tasks/global_piqa/prompted/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,013 copying lm_eval/tasks/global_piqa/prompted/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,015 copying lm_eval/tasks/global_piqa/prompted/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,017 copying lm_eval/tasks/global_piqa/prompted/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,020 copying lm_eval/tasks/global_piqa/prompted/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,022 copying lm_eval/tasks/global_piqa/prompted/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,024 copying lm_eval/tasks/global_piqa/prompted/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,026 copying lm_eval/tasks/global_piqa/prompted/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,028 copying lm_eval/tasks/global_piqa/prompted/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,031 copying lm_eval/tasks/global_piqa/prompted/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,033 copying lm_eval/tasks/global_piqa/prompted/luo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,035 copying lm_eval/tasks/global_piqa/prompted/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,037 copying lm_eval/tasks/global_piqa/prompted/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,039 copying lm_eval/tasks/global_piqa/prompted/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,255 copying lm_eval/tasks/global_piqa/prompted/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,258 copying lm_eval/tasks/global_piqa/prompted/bsk_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,260 copying lm_eval/tasks/global_piqa/prompted/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,262 copying lm_eval/tasks/global_piqa/prompted/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,264 copying lm_eval/tasks/global_piqa/prompted/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,266 copying lm_eval/tasks/global_piqa/prompted/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,268 copying lm_eval/tasks/global_piqa/prompted/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,271 copying lm_eval/tasks/global_piqa/prompted/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,274 copying lm_eval/tasks/global_piqa/prompted/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,276 copying lm_eval/tasks/global_piqa/prompted/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,279 copying lm_eval/tasks/global_piqa/prompted/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,282 copying lm_eval/tasks/global_piqa/prompted/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,284 copying lm_eval/tasks/global_piqa/prompted/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,287 copying lm_eval/tasks/global_piqa/prompted/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,290 copying lm_eval/tasks/global_piqa/prompted/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,292 copying lm_eval/tasks/global_piqa/prompted/asm_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,295 copying lm_eval/tasks/global_piqa/prompted/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,298 copying lm_eval/tasks/global_piqa/prompted/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,300 copying lm_eval/tasks/global_piqa/prompted/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,303 copying lm_eval/tasks/global_piqa/prompted/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,306 copying lm_eval/tasks/global_piqa/prompted/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,309 copying lm_eval/tasks/global_piqa/prompted/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,311 copying lm_eval/tasks/global_piqa/prompted/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,314 copying lm_eval/tasks/global_piqa/prompted/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,317 copying lm_eval/tasks/global_piqa/prompted/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,320 copying lm_eval/tasks/global_piqa/prompted/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,323 copying lm_eval/tasks/global_piqa/prompted/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,326 copying lm_eval/tasks/global_piqa/prompted/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,329 copying lm_eval/tasks/global_piqa/prompted/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,332 copying lm_eval/tasks/global_piqa/prompted/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,334 copying lm_eval/tasks/global_piqa/prompted/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,337 copying lm_eval/tasks/global_piqa/prompted/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,339 copying lm_eval/tasks/global_piqa/prompted/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,342 copying lm_eval/tasks/global_piqa/prompted/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,344 copying lm_eval/tasks/global_piqa/prompted/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,347 copying lm_eval/tasks/global_piqa/prompted/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,350 copying lm_eval/tasks/global_piqa/prompted/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,353 copying lm_eval/tasks/global_piqa/prompted/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,356 copying lm_eval/tasks/global_piqa/prompted/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,359 copying lm_eval/tasks/global_piqa/prompted/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,361 copying lm_eval/tasks/global_piqa/prompted/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,364 copying lm_eval/tasks/global_piqa/prompted/ckb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,367 copying lm_eval/tasks/global_piqa/prompted/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,369 copying lm_eval/tasks/global_piqa/prompted/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,371 copying lm_eval/tasks/global_piqa/prompted/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,374 copying lm_eval/tasks/global_piqa/prompted/mni_mtei.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,376 copying lm_eval/tasks/global_piqa/prompted/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,378 copying lm_eval/tasks/global_piqa/prompted/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,381 copying lm_eval/tasks/global_piqa/prompted/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,383 copying lm_eval/tasks/global_piqa/prompted/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,385 copying lm_eval/tasks/global_piqa/prompted/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,387 copying lm_eval/tasks/global_piqa/prompted/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,390 copying lm_eval/tasks/global_piqa/prompted/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,392 copying lm_eval/tasks/global_piqa/prompted/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,394 copying lm_eval/tasks/global_piqa/prompted/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,396 copying lm_eval/tasks/global_piqa/prompted/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,399 copying lm_eval/tasks/global_piqa/prompted/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,401 copying lm_eval/tasks/global_piqa/prompted/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,404 copying lm_eval/tasks/global_piqa/prompted/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,406 copying lm_eval/tasks/global_piqa/prompted/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:43,408 copying lm_eval/tasks/global_piqa/completions/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,410 copying lm_eval/tasks/global_piqa/completions/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,412 copying lm_eval/tasks/global_piqa/completions/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,415 copying lm_eval/tasks/global_piqa/completions/bos_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,417 copying lm_eval/tasks/global_piqa/completions/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,419 copying lm_eval/tasks/global_piqa/completions/kaz_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,421 copying lm_eval/tasks/global_piqa/completions/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,423 copying lm_eval/tasks/global_piqa/completions/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,425 copying lm_eval/tasks/global_piqa/completions/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,427 copying lm_eval/tasks/global_piqa/completions/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,429 copying lm_eval/tasks/global_piqa/completions/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,432 copying lm_eval/tasks/global_piqa/completions/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,434 copying lm_eval/tasks/global_piqa/completions/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,436 copying lm_eval/tasks/global_piqa/completions/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,439 copying lm_eval/tasks/global_piqa/completions/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,441 copying lm_eval/tasks/global_piqa/completions/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,443 copying lm_eval/tasks/global_piqa/completions/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,445 copying lm_eval/tasks/global_piqa/completions/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,447 copying lm_eval/tasks/global_piqa/completions/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,450 copying lm_eval/tasks/global_piqa/completions/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,452 copying lm_eval/tasks/global_piqa/completions/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,454 copying lm_eval/tasks/global_piqa/completions/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,456 copying lm_eval/tasks/global_piqa/completions/_global_piqa.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,459 copying lm_eval/tasks/global_piqa/completions/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,461 copying lm_eval/tasks/global_piqa/completions/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,464 copying lm_eval/tasks/global_piqa/completions/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,466 copying lm_eval/tasks/global_piqa/completions/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,468 copying lm_eval/tasks/global_piqa/completions/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,470 copying lm_eval/tasks/global_piqa/completions/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,472 copying lm_eval/tasks/global_piqa/completions/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,475 copying lm_eval/tasks/global_piqa/completions/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,477 copying lm_eval/tasks/global_piqa/completions/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,479 copying lm_eval/tasks/global_piqa/completions/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,481 copying lm_eval/tasks/global_piqa/completions/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,484 copying lm_eval/tasks/global_piqa/completions/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,486 copying lm_eval/tasks/global_piqa/completions/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,488 copying lm_eval/tasks/global_piqa/completions/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,490 copying lm_eval/tasks/global_piqa/completions/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,493 copying lm_eval/tasks/global_piqa/completions/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,495 copying lm_eval/tasks/global_piqa/completions/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,497 copying lm_eval/tasks/global_piqa/completions/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,500 copying lm_eval/tasks/global_piqa/completions/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,502 copying lm_eval/tasks/global_piqa/completions/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,504 copying lm_eval/tasks/global_piqa/completions/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,507 copying lm_eval/tasks/global_piqa/completions/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,509 copying lm_eval/tasks/global_piqa/completions/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,511 copying lm_eval/tasks/global_piqa/completions/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,513 copying lm_eval/tasks/global_piqa/completions/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,516 copying lm_eval/tasks/global_piqa/completions/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,518 copying lm_eval/tasks/global_piqa/completions/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,520 copying lm_eval/tasks/global_piqa/completions/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,522 copying lm_eval/tasks/global_piqa/completions/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,524 copying lm_eval/tasks/global_piqa/completions/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,527 copying lm_eval/tasks/global_piqa/completions/luo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,529 copying lm_eval/tasks/global_piqa/completions/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,531 copying lm_eval/tasks/global_piqa/completions/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,533 copying lm_eval/tasks/global_piqa/completions/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,536 copying lm_eval/tasks/global_piqa/completions/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,538 copying lm_eval/tasks/global_piqa/completions/bsk_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,540 copying lm_eval/tasks/global_piqa/completions/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,542 copying lm_eval/tasks/global_piqa/completions/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,545 copying lm_eval/tasks/global_piqa/completions/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,547 copying lm_eval/tasks/global_piqa/completions/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,549 copying lm_eval/tasks/global_piqa/completions/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,552 copying lm_eval/tasks/global_piqa/completions/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,554 copying lm_eval/tasks/global_piqa/completions/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,556 copying lm_eval/tasks/global_piqa/completions/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,558 copying lm_eval/tasks/global_piqa/completions/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,560 copying lm_eval/tasks/global_piqa/completions/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,562 copying lm_eval/tasks/global_piqa/completions/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,565 copying lm_eval/tasks/global_piqa/completions/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,567 copying lm_eval/tasks/global_piqa/completions/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,569 copying lm_eval/tasks/global_piqa/completions/asm_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,572 copying lm_eval/tasks/global_piqa/completions/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,575 copying lm_eval/tasks/global_piqa/completions/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,577 copying lm_eval/tasks/global_piqa/completions/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,579 copying lm_eval/tasks/global_piqa/completions/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,582 copying lm_eval/tasks/global_piqa/completions/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,584 copying lm_eval/tasks/global_piqa/completions/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,587 copying lm_eval/tasks/global_piqa/completions/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,589 copying lm_eval/tasks/global_piqa/completions/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,592 copying lm_eval/tasks/global_piqa/completions/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,594 copying lm_eval/tasks/global_piqa/completions/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,597 copying lm_eval/tasks/global_piqa/completions/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,599 copying lm_eval/tasks/global_piqa/completions/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,601 copying lm_eval/tasks/global_piqa/completions/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,604 copying lm_eval/tasks/global_piqa/completions/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,606 copying lm_eval/tasks/global_piqa/completions/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,608 copying lm_eval/tasks/global_piqa/completions/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,610 copying lm_eval/tasks/global_piqa/completions/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,612 copying lm_eval/tasks/global_piqa/completions/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,615 copying lm_eval/tasks/global_piqa/completions/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,617 copying lm_eval/tasks/global_piqa/completions/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,619 copying lm_eval/tasks/global_piqa/completions/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,622 copying lm_eval/tasks/global_piqa/completions/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,624 copying lm_eval/tasks/global_piqa/completions/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,626 copying lm_eval/tasks/global_piqa/completions/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,629 copying lm_eval/tasks/global_piqa/completions/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,631 copying lm_eval/tasks/global_piqa/completions/ckb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,633 copying lm_eval/tasks/global_piqa/completions/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,635 copying lm_eval/tasks/global_piqa/completions/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,638 copying lm_eval/tasks/global_piqa/completions/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,640 copying lm_eval/tasks/global_piqa/completions/mni_mtei.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,642 copying lm_eval/tasks/global_piqa/completions/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,644 copying lm_eval/tasks/global_piqa/completions/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,647 copying lm_eval/tasks/global_piqa/completions/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,649 copying lm_eval/tasks/global_piqa/completions/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,651 copying lm_eval/tasks/global_piqa/completions/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,654 copying lm_eval/tasks/global_piqa/completions/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,656 copying lm_eval/tasks/global_piqa/completions/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,658 copying lm_eval/tasks/global_piqa/completions/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,662 copying lm_eval/tasks/global_piqa/completions/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,665 copying lm_eval/tasks/global_piqa/completions/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,667 copying lm_eval/tasks/global_piqa/completions/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,669 copying lm_eval/tasks/global_piqa/completions/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,672 copying lm_eval/tasks/global_piqa/completions/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,674 copying lm_eval/tasks/global_piqa/completions/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:43,677 copying lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,679 copying lm_eval/tasks/unitxt/doc_vqa.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,681 copying lm_eval/tasks/unitxt/argument_topic.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,683 copying lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,685 copying lm_eval/tasks/unitxt/coedit_gec.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,688 copying lm_eval/tasks/unitxt/unfair_tos.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,690 copying lm_eval/tasks/unitxt/ledgar.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,692 copying lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,694 copying lm_eval/tasks/unitxt/ethos_binary.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,697 copying lm_eval/tasks/unitxt/ag_news.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,699 copying lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,701 copying lm_eval/tasks/unitxt/financial_tweets.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,704 copying lm_eval/tasks/unitxt/stsb.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,707 copying lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,709 copying lm_eval/tasks/unitxt/atis.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,711 copying lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,714 copying lm_eval/tasks/unitxt/xsum.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,716 copying lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,718 copying lm_eval/tasks/unitxt/banking77.yaml -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:43,721 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete 2026-02-14T10:25:43,724 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-02-14T10:25:43,726 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-02-14T10:25:43,729 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-02-14T10:25:43,731 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-02-14T10:25:43,734 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-02-14T10:25:43,736 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-02-14T10:25:43,739 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-02-14T10:25:43,741 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-02-14T10:25:43,744 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-02-14T10:25:43,746 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-02-14T10:25:43,749 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-02-14T10:25:43,751 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-02-14T10:25:43,754 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:43,756 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:43,759 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:43,761 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:43,763 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:43,765 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:43,768 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:43,770 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:43,772 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:43,775 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:25:43,777 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-02-14T10:25:43,779 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-02-14T10:25:43,782 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-02-14T10:25:43,784 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-02-14T10:25:43,787 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,789 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,792 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,795 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,797 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,799 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,802 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,804 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,807 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,809 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,811 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,814 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,816 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,819 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,821 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,824 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,826 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,829 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,831 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,833 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,836 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,838 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,841 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,843 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,846 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,848 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,851 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,853 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,856 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,858 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,861 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,863 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,866 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,868 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,870 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,873 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,875 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,877 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,880 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,882 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,885 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,887 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,890 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,892 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,895 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,897 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,899 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,902 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,904 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,907 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,909 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,911 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,914 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,916 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,919 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,922 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,924 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,927 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:25:43,929 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-02-14T10:25:43,932 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-02-14T10:25:43,935 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-02-14T10:25:43,937 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-02-14T10:25:43,940 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,942 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,945 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,947 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,950 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,953 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,955 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,957 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,959 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,961 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,965 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,967 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,969 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,972 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,974 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,977 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,979 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,982 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,984 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,987 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,989 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,992 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,994 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,996 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:43,998 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,001 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,003 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,005 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,008 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,010 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,013 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,015 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,018 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,020 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,023 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,025 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,028 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,030 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,033 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,036 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,038 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,041 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,043 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,046 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,049 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,051 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,053 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,055 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,058 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,060 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,062 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,065 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,067 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,070 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,072 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,074 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,077 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,079 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,082 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:25:44,084 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-02-14T10:25:44,087 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-02-14T10:25:44,089 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-02-14T10:25:44,092 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-02-14T10:25:44,094 copying lm_eval/tasks/logiqa2/logiqa2.yaml -> build/lib/lm_eval/tasks/logiqa2 2026-02-14T10:25:44,097 copying lm_eval/tasks/logiqa2/logieval.yaml -> build/lib/lm_eval/tasks/logiqa2 2026-02-14T10:25:44,100 copying lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/multirc 2026-02-14T10:25:44,102 copying lm_eval/tasks/super_glue/multirc/default.yaml -> build/lib/lm_eval/tasks/super_glue/multirc 2026-02-14T10:25:44,105 creating build/lib/lm_eval/tasks/super_glue/rte 2026-02-14T10:25:44,106 copying lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/rte 2026-02-14T10:25:44,108 copying lm_eval/tasks/super_glue/rte/default.yaml -> build/lib/lm_eval/tasks/super_glue/rte 2026-02-14T10:25:44,110 creating build/lib/lm_eval/tasks/super_glue/wic 2026-02-14T10:25:44,112 copying lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wic 2026-02-14T10:25:44,114 copying lm_eval/tasks/super_glue/wic/default.yaml -> build/lib/lm_eval/tasks/super_glue/wic 2026-02-14T10:25:44,117 copying lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wsc 2026-02-14T10:25:44,119 copying lm_eval/tasks/super_glue/wsc/default.yaml -> build/lib/lm_eval/tasks/super_glue/wsc 2026-02-14T10:25:44,122 copying lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/record 2026-02-14T10:25:44,124 copying lm_eval/tasks/super_glue/record/default.yaml -> build/lib/lm_eval/tasks/super_glue/record 2026-02-14T10:25:44,126 creating build/lib/lm_eval/tasks/super_glue/boolq 2026-02-14T10:25:44,128 copying lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2026-02-14T10:25:44,130 copying lm_eval/tasks/super_glue/boolq/default.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2026-02-14T10:25:44,133 copying lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2026-02-14T10:25:44,136 copying lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/copa 2026-02-14T10:25:44,138 copying lm_eval/tasks/super_glue/copa/default.yaml -> build/lib/lm_eval/tasks/super_glue/copa 2026-02-14T10:25:44,141 copying lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/cb 2026-02-14T10:25:44,143 copying lm_eval/tasks/super_glue/cb/default.yaml -> build/lib/lm_eval/tasks/super_glue/cb 2026-02-14T10:25:44,146 copying lm_eval/tasks/lingoly/lingoly_group.yaml -> build/lib/lm_eval/tasks/lingoly 2026-02-14T10:25:44,148 copying lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/lib/lm_eval/tasks/lingoly 2026-02-14T10:25:44,151 copying lm_eval/tasks/lingoly/lingoly_context.yaml -> build/lib/lm_eval/tasks/lingoly 2026-02-14T10:25:44,153 copying lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/lib/lm_eval/tasks/pubmedqa 2026-02-14T10:25:44,156 copying lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml -> build/lib/lm_eval/tasks/meddialog 2026-02-14T10:25:44,158 copying lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml -> build/lib/lm_eval/tasks/meddialog 2026-02-14T10:25:44,161 copying lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml -> build/lib/lm_eval/tasks/meddialog 2026-02-14T10:25:44,163 copying lm_eval/tasks/meddialog/meddialog_qsumm.yaml -> build/lib/lm_eval/tasks/meddialog 2026-02-14T10:25:44,166 copying lm_eval/tasks/squadv2/squadv2.yaml -> build/lib/lm_eval/tasks/squadv2 2026-02-14T10:25:44,168 copying lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-02-14T10:25:44,171 copying lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-02-14T10:25:44,173 copying lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-02-14T10:25:44,175 copying lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-02-14T10:25:44,178 copying lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-02-14T10:25:44,180 copying lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,183 copying lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,185 copying lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,188 copying lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,190 copying lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,193 copying lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,195 copying lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,197 copying lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,200 copying lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,202 copying lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,204 copying lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,207 copying lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,209 copying lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,211 copying lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,214 copying lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,216 copying lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,219 copying lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,221 copying lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,223 copying lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,226 copying lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,228 copying lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,231 copying lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,233 copying lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,236 copying lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,238 copying lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,240 copying lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,243 copying lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,246 copying lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,248 copying lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,250 copying lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,252 copying lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,255 copying lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,257 copying lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,259 copying lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,262 copying lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,264 copying lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,267 copying lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,270 copying lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,272 copying lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,274 copying lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,277 copying lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,279 copying lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,281 copying lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,283 copying lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,286 copying lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,290 copying lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,292 copying lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,294 copying lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,297 copying lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,299 copying lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,301 copying lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,304 copying lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,306 copying lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,308 copying lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,311 copying lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,313 copying lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,315 copying lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,318 copying lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,320 copying lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,323 copying lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,325 copying lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,328 copying lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,330 copying lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,333 copying lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,335 copying lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,338 copying lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,340 copying lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,342 copying lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:44,345 copying lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml -> build/lib/lm_eval/tasks/afrixnli/translate 2026-02-14T10:25:44,348 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,350 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,352 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,355 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,357 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,359 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,361 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,364 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,366 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,369 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,371 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,373 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,376 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,379 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,381 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,383 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,385 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:44,388 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,390 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,392 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,394 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,397 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,399 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,402 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,404 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,406 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,409 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,411 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,413 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,415 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,418 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,421 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,423 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,426 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:44,428 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,431 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,433 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,435 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,438 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,440 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,442 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,445 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,447 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,449 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,452 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,454 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,456 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,459 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,461 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,464 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,466 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:44,468 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,470 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,472 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,475 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,477 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,479 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,481 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,484 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,486 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,488 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,490 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,493 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,495 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,497 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,500 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,502 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,504 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:44,507 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,509 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,511 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,513 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,515 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,518 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,520 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,522 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,525 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,527 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,529 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,531 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,534 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,536 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,538 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,540 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,542 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:44,545 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,547 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,550 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,552 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,555 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,557 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,559 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,561 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,564 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,566 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,568 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,571 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,573 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,575 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,577 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,579 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,581 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:44,584 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,586 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,588 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,590 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,593 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,595 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,597 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,599 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,601 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,604 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,606 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,608 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,610 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,612 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,615 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,617 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,619 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,621 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:44,623 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,626 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,628 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,630 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,632 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,634 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,636 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,639 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,641 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,643 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,645 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,647 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,650 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,652 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,654 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,656 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,658 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,660 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:44,663 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,665 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,667 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,669 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,672 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,674 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,676 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,679 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,681 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,683 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,685 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,688 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,690 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,693 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,696 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,699 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,701 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:44,703 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,706 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,708 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,711 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,713 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,715 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,718 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,721 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,723 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,726 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,728 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,730 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,732 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,734 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,737 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,740 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,742 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,745 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:44,748 copying lm_eval/tasks/afrixnli/direct/afrixnli.yaml -> build/lib/lm_eval/tasks/afrixnli/direct 2026-02-14T10:25:44,750 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,752 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,754 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,756 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,759 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,761 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,764 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,766 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,769 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,771 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,773 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,775 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,777 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,780 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,782 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,784 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,787 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,789 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:44,791 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,794 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,796 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,798 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,800 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,803 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,805 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,807 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,810 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,812 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,814 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,816 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,819 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,821 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,823 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,825 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,827 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,829 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:44,831 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,833 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,836 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,838 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,841 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,843 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,845 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,848 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,850 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,852 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,855 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,858 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,860 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,863 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,865 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,867 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,869 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,871 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:44,874 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,876 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,878 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,880 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,882 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,885 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,887 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,889 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,891 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,893 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,895 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,898 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,900 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,902 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,904 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,907 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,909 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,911 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:44,913 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,915 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,918 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,920 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,922 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,924 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,926 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,928 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,930 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,933 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,935 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,937 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,939 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,941 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,943 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,946 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,948 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,950 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:44,952 creating build/lib/lm_eval/tasks/siqa 2026-02-14T10:25:44,954 copying lm_eval/tasks/siqa/siqa.yaml -> build/lib/lm_eval/tasks/siqa 2026-02-14T10:25:44,957 copying lm_eval/tasks/egyhellaswag/egyhellaswag.yaml -> build/lib/lm_eval/tasks/egyhellaswag 2026-02-14T10:25:44,959 creating build/lib/lm_eval/tasks/gsm8k_platinum 2026-02-14T10:25:44,961 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-02-14T10:25:44,963 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-02-14T10:25:44,965 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-02-14T10:25:44,968 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-02-14T10:25:44,970 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-02-14T10:25:44,972 creating build/lib/lm_eval/tasks/aexams 2026-02-14T10:25:44,973 copying lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/lib/lm_eval/tasks/aexams 2026-02-14T10:25:44,975 copying lm_eval/tasks/aexams/aexams_Social.yaml -> build/lib/lm_eval/tasks/aexams 2026-02-14T10:25:44,977 copying lm_eval/tasks/aexams/aexams_Science.yaml -> build/lib/lm_eval/tasks/aexams 2026-02-14T10:25:44,979 copying lm_eval/tasks/aexams/aexams_Biology.yaml -> build/lib/lm_eval/tasks/aexams 2026-02-14T10:25:44,982 copying lm_eval/tasks/aexams/aexams_Physics.yaml -> build/lib/lm_eval/tasks/aexams 2026-02-14T10:25:44,984 copying lm_eval/tasks/aexams/_aexams.yaml -> build/lib/lm_eval/tasks/aexams 2026-02-14T10:25:44,986 copying lm_eval/tasks/toxigen/toxigen.yaml -> build/lib/lm_eval/tasks/toxigen 2026-02-14T10:25:44,988 copying lm_eval/tasks/README.md -> build/lib/lm_eval/tasks 2026-02-14T10:25:44,996 copying lm_eval/tasks/copal_id/README.md -> build/lib/lm_eval/tasks/copal_id 2026-02-14T10:25:45,000 copying lm_eval/tasks/noreval/noreval.jpg -> build/lib/lm_eval/tasks/noreval 2026-02-14T10:25:45,022 copying lm_eval/tasks/noreval/README.md -> build/lib/lm_eval/tasks/noreval 2026-02-14T10:25:45,025 copying lm_eval/tasks/noreval/ask_gec/README.md -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:45,027 copying lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:45,030 copying lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:45,033 copying lm_eval/tasks/noreval/norec/_norec_yaml -> build/lib/lm_eval/tasks/noreval/norec 2026-02-14T10:25:45,036 copying lm_eval/tasks/noreval/norsumm/_norsumm_yaml -> build/lib/lm_eval/tasks/noreval/norsumm 2026-02-14T10:25:45,040 copying lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml -> build/lib/lm_eval/tasks/noreval/tatoeba 2026-02-14T10:25:45,042 copying lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa 2026-02-14T10:25:45,047 copying lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa 2026-02-14T10:25:45,050 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2026-02-14T10:25:45,054 copying lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-02-14T10:25:45,057 copying lm_eval/tasks/noreval/noridiom/_noridiom_yaml -> build/lib/lm_eval/tasks/noreval/noridiom 2026-02-14T10:25:45,060 copying lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa 2026-02-14T10:25:45,063 copying lm_eval/tasks/noreval/norquad/_norquad_yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-02-14T10:25:45,066 copying lm_eval/tasks/prost/README.md -> build/lib/lm_eval/tasks/prost 2026-02-14T10:25:45,069 copying lm_eval/tasks/mimic_repsum/README.md -> build/lib/lm_eval/tasks/mimic_repsum 2026-02-14T10:25:45,072 copying lm_eval/tasks/arabicmmlu/README.md -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:45,076 copying lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:45,079 copying lm_eval/tasks/lm_syneval/README.md -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:45,082 copying lm_eval/tasks/lm_syneval/_template_yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-02-14T10:25:45,084 copying lm_eval/tasks/simple_cooccurrence_bias/README.md -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-02-14T10:25:45,088 copying lm_eval/tasks/tmlu/README.md -> build/lib/lm_eval/tasks/tmlu 2026-02-14T10:25:45,090 copying lm_eval/tasks/tmlu/subject.tsv -> build/lib/lm_eval/tasks/tmlu 2026-02-14T10:25:45,093 copying lm_eval/tasks/tmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-02-14T10:25:45,097 copying lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:45,099 copying lm_eval/tasks/inverse_scaling/_some_results -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:45,101 copying lm_eval/tasks/inverse_scaling/README.md -> build/lib/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:45,104 copying lm_eval/tasks/turkishmmlu/README.md -> build/lib/lm_eval/tasks/turkishmmlu 2026-02-14T10:25:45,107 copying lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:45,110 copying lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:45,112 copying lm_eval/tasks/mastermind/README.md -> build/lib/lm_eval/tasks/mastermind 2026-02-14T10:25:45,115 copying lm_eval/tasks/sciq/README.md -> build/lib/lm_eval/tasks/sciq 2026-02-14T10:25:45,117 copying lm_eval/tasks/winogender/README.md -> build/lib/lm_eval/tasks/winogender 2026-02-14T10:25:45,121 copying lm_eval/tasks/code_x_glue/code-text/_default_template_yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:45,124 copying lm_eval/tasks/code_x_glue/code-text/README.md -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:45,127 copying lm_eval/tasks/arc_mt/README.md -> build/lib/lm_eval/tasks/arc_mt 2026-02-14T10:25:45,130 copying lm_eval/tasks/wsc273/README.md -> build/lib/lm_eval/tasks/wsc273 2026-02-14T10:25:45,133 copying lm_eval/tasks/lambada/README.md -> build/lib/lm_eval/tasks/lambada 2026-02-14T10:25:45,136 copying lm_eval/tasks/fda/README.md -> build/lib/lm_eval/tasks/fda 2026-02-14T10:25:45,139 copying lm_eval/tasks/lambada_cloze/README.md -> build/lib/lm_eval/tasks/lambada_cloze 2026-02-14T10:25:45,141 copying lm_eval/tasks/aclue/_default_template_yaml -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:45,144 copying lm_eval/tasks/aclue/README.md -> build/lib/lm_eval/tasks/aclue 2026-02-14T10:25:45,147 copying lm_eval/tasks/anli/README.md -> build/lib/lm_eval/tasks/anli 2026-02-14T10:25:45,150 copying lm_eval/tasks/acpbench/README.md -> build/lib/lm_eval/tasks/acpbench 2026-02-14T10:25:45,153 copying lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:45,155 copying lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:45,157 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:45,159 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:45,162 copying lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:45,168 copying lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:45,171 copying lm_eval/tasks/kobest/README.md -> build/lib/lm_eval/tasks/kobest 2026-02-14T10:25:45,174 copying lm_eval/tasks/basque_bench/README.md -> build/lib/lm_eval/tasks/basque_bench 2026-02-14T10:25:45,178 copying lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:45,181 copying lm_eval/tasks/moral_stories/README.md -> build/lib/lm_eval/tasks/moral_stories 2026-02-14T10:25:45,184 copying lm_eval/tasks/piqa/README.md -> build/lib/lm_eval/tasks/piqa 2026-02-14T10:25:45,187 copying lm_eval/tasks/paws-x/pawsx_template_yaml -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:25:45,189 copying lm_eval/tasks/paws-x/README.md -> build/lib/lm_eval/tasks/paws-x 2026-02-14T10:25:45,193 copying lm_eval/tasks/bhs/README.md -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:45,196 copying lm_eval/tasks/bhs/_template_yaml -> build/lib/lm_eval/tasks/bhs 2026-02-14T10:25:45,199 copying lm_eval/tasks/wikitext/README.md -> build/lib/lm_eval/tasks/wikitext 2026-02-14T10:25:45,201 copying lm_eval/tasks/eus_trivia/README.md -> build/lib/lm_eval/tasks/eus_trivia 2026-02-14T10:25:45,204 copying lm_eval/tasks/hendrycks_math/README.md -> build/lib/lm_eval/tasks/hendrycks_math 2026-02-14T10:25:45,208 copying lm_eval/tasks/medtext/README.md -> build/lib/lm_eval/tasks/medtext 2026-02-14T10:25:45,211 copying lm_eval/tasks/ceval/README.md -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:45,214 copying lm_eval/tasks/ceval/_default_ceval_yaml -> build/lib/lm_eval/tasks/ceval 2026-02-14T10:25:45,217 copying lm_eval/tasks/kbl/README.md -> build/lib/lm_eval/tasks/kbl 2026-02-14T10:25:45,220 copying lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:45,222 copying lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:45,225 copying lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:45,227 copying lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:45,230 copying lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:45,232 copying lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:45,236 copying lm_eval/tasks/jsonschema_bench/README.md -> build/lib/lm_eval/tasks/jsonschema_bench 2026-02-14T10:25:45,238 copying lm_eval/tasks/babi/README.md -> build/lib/lm_eval/tasks/babi 2026-02-14T10:25:45,241 copying lm_eval/tasks/glue/README.md -> build/lib/lm_eval/tasks/glue 2026-02-14T10:25:45,245 copying lm_eval/tasks/longbench2/README.md -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:45,247 copying lm_eval/tasks/longbench2/_longbench_common_yaml -> build/lib/lm_eval/tasks/longbench2 2026-02-14T10:25:45,250 copying lm_eval/tasks/humaneval_infilling/README.md -> build/lib/lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:45,254 copying lm_eval/tasks/qa4mre/README.md -> build/lib/lm_eval/tasks/qa4mre 2026-02-14T10:25:45,256 copying lm_eval/tasks/webqs/README.md -> build/lib/lm_eval/tasks/webqs 2026-02-14T10:25:45,259 copying lm_eval/tasks/alghafa/copa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/copa_ar 2026-02-14T10:25:45,262 copying lm_eval/tasks/alghafa/piqa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/piqa_ar 2026-02-14T10:25:45,264 copying lm_eval/tasks/meqsum/README.md -> build/lib/lm_eval/tasks/meqsum 2026-02-14T10:25:45,267 copying lm_eval/tasks/mmlusr/README.md -> build/lib/lm_eval/tasks/mmlusr 2026-02-14T10:25:45,270 copying lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:45,273 copying lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:45,276 copying lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:45,279 copying lm_eval/tasks/glianorex/README.md -> build/lib/lm_eval/tasks/glianorex 2026-02-14T10:25:45,282 copying lm_eval/tasks/hellaswag/README.md -> build/lib/lm_eval/tasks/hellaswag 2026-02-14T10:25:45,285 copying lm_eval/tasks/gsm8k/README.md -> build/lib/lm_eval/tasks/gsm8k 2026-02-14T10:25:45,288 copying lm_eval/tasks/swag/README.md -> build/lib/lm_eval/tasks/swag 2026-02-14T10:25:45,290 copying lm_eval/tasks/spanish_bench/README.md -> build/lib/lm_eval/tasks/spanish_bench 2026-02-14T10:25:45,294 copying lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-02-14T10:25:45,296 copying lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:45,299 copying lm_eval/tasks/egymmlu/README.md -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:45,302 copying lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml -> build/lib/lm_eval/tasks/egymmlu 2026-02-14T10:25:45,306 copying lm_eval/tasks/mediqa_qa2019/README.md -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-02-14T10:25:45,309 copying lm_eval/tasks/headqa/README.md -> build/lib/lm_eval/tasks/headqa 2026-02-14T10:25:45,312 copying lm_eval/tasks/kmmlu/README.md -> build/lib/lm_eval/tasks/kmmlu 2026-02-14T10:25:45,314 copying lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:45,317 copying lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:45,319 copying lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:45,322 copying lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:45,324 copying lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:45,326 copying lm_eval/tasks/openbookqa/README.md -> build/lib/lm_eval/tasks/openbookqa 2026-02-14T10:25:45,329 copying lm_eval/tasks/xquad/README.md -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:45,331 copying lm_eval/tasks/xquad/xquad_common_yaml -> build/lib/lm_eval/tasks/xquad 2026-02-14T10:25:45,334 copying lm_eval/tasks/zhoblimp/README.md -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:45,336 copying lm_eval/tasks/zhoblimp/_template_yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-02-14T10:25:45,340 copying lm_eval/tasks/swde/README.md -> build/lib/lm_eval/tasks/swde 2026-02-14T10:25:45,343 copying lm_eval/tasks/mts_dialog/README.md -> build/lib/lm_eval/tasks/mts_dialog 2026-02-14T10:25:45,347 copying lm_eval/tasks/gsm_plus/README.md -> build/lib/lm_eval/tasks/gsm_plus 2026-02-14T10:25:45,349 copying lm_eval/tasks/ulqa/README.md -> build/lib/lm_eval/tasks/ulqa 2026-02-14T10:25:45,352 copying lm_eval/tasks/xnli_eu/README.md -> build/lib/lm_eval/tasks/xnli_eu 2026-02-14T10:25:45,354 copying lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-02-14T10:25:45,357 copying lm_eval/tasks/translation/README.md -> build/lib/lm_eval/tasks/translation 2026-02-14T10:25:45,359 copying lm_eval/tasks/translation/wmt_common_yaml -> build/lib/lm_eval/tasks/translation 2026-02-14T10:25:45,362 copying lm_eval/tasks/arabic_leaderboard_light/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_light 2026-02-14T10:25:45,375 copying lm_eval/tasks/race/README.md -> build/lib/lm_eval/tasks/race 2026-02-14T10:25:45,378 copying lm_eval/tasks/bbh/README.md -> build/lib/lm_eval/tasks/bbh 2026-02-14T10:25:45,381 copying lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:25:45,384 copying lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:25:45,387 copying lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:25:45,390 copying lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-02-14T10:25:45,392 copying lm_eval/tasks/leaderboard/README.md -> build/lib/lm_eval/tasks/leaderboard 2026-02-14T10:25:45,394 copying lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:25:45,397 copying lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:25:45,400 copying lm_eval/tasks/leaderboard/math/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-02-14T10:25:45,406 copying lm_eval/tasks/leaderboard/musr/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-02-14T10:25:45,409 copying lm_eval/tasks/mutual/README.md -> build/lib/lm_eval/tasks/mutual 2026-02-14T10:25:45,412 copying lm_eval/tasks/e2lmc/noor/_noor_template -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:45,414 copying lm_eval/tasks/e2lmc/noor/README.md -> build/lib/lm_eval/tasks/e2lmc/noor 2026-02-14T10:25:45,417 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/_var5shots_template_yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:25:45,420 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/README.md -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:25:45,423 copying lm_eval/tasks/e2lmc/mmlu_early_training/README.md -> build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-02-14T10:25:45,425 copying lm_eval/tasks/eq_bench/README.md -> build/lib/lm_eval/tasks/eq_bench 2026-02-14T10:25:45,429 copying lm_eval/tasks/haerae/README.md -> build/lib/lm_eval/tasks/haerae 2026-02-14T10:25:45,432 copying lm_eval/tasks/haerae/_default_haerae_yaml -> build/lib/lm_eval/tasks/haerae 2026-02-14T10:25:45,434 copying lm_eval/tasks/crows_pairs/README.md -> build/lib/lm_eval/tasks/crows_pairs 2026-02-14T10:25:45,437 copying lm_eval/tasks/eus_proficiency/README.md -> build/lib/lm_eval/tasks/eus_proficiency 2026-02-14T10:25:45,440 copying lm_eval/tasks/qasper/README.md -> build/lib/lm_eval/tasks/qasper 2026-02-14T10:25:45,444 copying lm_eval/tasks/evalita_llm/_sum_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,446 copying lm_eval/tasks/evalita_llm/_re_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,448 copying lm_eval/tasks/evalita_llm/_faq_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,450 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,453 copying lm_eval/tasks/evalita_llm/_hs_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,455 copying lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,458 copying lm_eval/tasks/evalita_llm/README.md -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,460 copying lm_eval/tasks/evalita_llm/_sa_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,463 copying lm_eval/tasks/evalita_llm/_at_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,465 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,467 copying lm_eval/tasks/evalita_llm/_sa_template_v2_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,469 copying lm_eval/tasks/evalita_llm/_te_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,471 copying lm_eval/tasks/evalita_llm/_ner_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,474 copying lm_eval/tasks/evalita_llm/_sum_template_fp_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,477 copying lm_eval/tasks/evalita_llm/_wic_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,479 copying lm_eval/tasks/evalita_llm/_ls_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,481 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn -> build/lib/lm_eval/tasks/evalita_llm 2026-02-14T10:25:45,483 copying lm_eval/tasks/score/NON_GREEDY.md -> build/lib/lm_eval/tasks/score 2026-02-14T10:25:45,485 copying lm_eval/tasks/score/README.md -> build/lib/lm_eval/tasks/score 2026-02-14T10:25:45,488 copying lm_eval/tasks/score/non_greedy.sh -> build/lib/lm_eval/tasks/score 2026-02-14T10:25:45,491 copying lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/lib/lm_eval/tasks/score/agi_eval 2026-02-14T10:25:45,495 copying lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-02-14T10:25:45,498 copying lm_eval/tasks/score/math/prompt_templates.json -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:45,501 copying lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/lib/lm_eval/tasks/score/math 2026-02-14T10:25:45,504 copying lm_eval/tasks/bangla/README.md -> build/lib/lm_eval/tasks/bangla 2026-02-14T10:25:45,507 copying lm_eval/tasks/include/README.md -> build/lib/lm_eval/tasks/include 2026-02-14T10:25:45,509 copying lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:25:45,512 copying lm_eval/tasks/include/default/Dutch/_dutch_template_yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-02-14T10:25:45,515 copying lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:25:45,518 copying lm_eval/tasks/include/default/Georgian/_georgian_template_yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2026-02-14T10:25:45,522 copying lm_eval/tasks/include/default/Urdu/_urdu_template_yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-02-14T10:25:45,525 copying lm_eval/tasks/include/default/Japanese/_japanese_template_yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-02-14T10:25:45,528 copying lm_eval/tasks/include/default/Korean/_korean_template_yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-02-14T10:25:45,531 copying lm_eval/tasks/include/default/Spanish/_spanish_template_yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-02-14T10:25:45,534 copying lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:25:45,536 copying lm_eval/tasks/include/default/Telugu/_telugu_template_yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-02-14T10:25:45,539 copying lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-02-14T10:25:45,542 copying lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-02-14T10:25:45,545 copying lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-02-14T10:25:45,548 copying lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-02-14T10:25:45,551 copying lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-02-14T10:25:45,554 copying lm_eval/tasks/include/default/Persian/_persian_template_yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-02-14T10:25:45,558 copying lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:25:45,560 copying lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-02-14T10:25:45,563 copying lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-02-14T10:25:45,567 copying lm_eval/tasks/include/default/Malay/_malay_template_yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-02-14T10:25:45,569 copying lm_eval/tasks/include/default/Bengali/_bengali_template_yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-02-14T10:25:45,572 copying lm_eval/tasks/include/default/Chinese/_chinese_template_yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-02-14T10:25:45,575 copying lm_eval/tasks/include/default/Polish/_polish_template_yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-02-14T10:25:45,578 copying lm_eval/tasks/include/default/Estonian/_estonian_template_yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-02-14T10:25:45,581 copying lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-02-14T10:25:45,585 copying lm_eval/tasks/include/default/Tamil/_tamil_template_yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-02-14T10:25:45,588 copying lm_eval/tasks/include/default/Croatian/_croatian_template_yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-02-14T10:25:45,591 copying lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-02-14T10:25:45,594 copying lm_eval/tasks/include/default/Finnish/_finnish_template_yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-02-14T10:25:45,598 copying lm_eval/tasks/include/default/Albanian/_albanian_template_yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-02-14T10:25:45,600 copying lm_eval/tasks/include/default/Serbian/_serbian_template_yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-02-14T10:25:45,604 copying lm_eval/tasks/include/default/Russian/_russian_template_yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-02-14T10:25:45,607 copying lm_eval/tasks/include/default/Italian/_italian_template_yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-02-14T10:25:45,611 copying lm_eval/tasks/include/default/North Macedonian/_north macedonian_template_yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:25:45,613 copying lm_eval/tasks/include/default/German/_german_template_yaml -> build/lib/lm_eval/tasks/include/default/German 2026-02-14T10:25:45,616 copying lm_eval/tasks/include/default/Armenian/_armenian_template_yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-02-14T10:25:45,619 copying lm_eval/tasks/include/default/Basque/_basque_template_yaml -> build/lib/lm_eval/tasks/include/default/Basque 2026-02-14T10:25:45,622 copying lm_eval/tasks/include/default/Greek/_greek_template_yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-02-14T10:25:45,625 copying lm_eval/tasks/include/default/French/_french_template_yaml -> build/lib/lm_eval/tasks/include/default/French 2026-02-14T10:25:45,628 copying lm_eval/tasks/include/default/Hindi/_hindi_template_yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-02-14T10:25:45,631 copying lm_eval/tasks/include/default/Arabic/_arabic_template_yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-02-14T10:25:45,634 copying lm_eval/tasks/include/default/Turkish/_turkish_template_yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-02-14T10:25:45,637 copying lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:25:45,641 copying lm_eval/tasks/include/default/Nepali/_nepali_template_yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-02-14T10:25:45,644 copying lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:25:45,647 copying lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:25:45,649 copying lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:25:45,652 copying lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-02-14T10:25:45,655 copying lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:25:45,658 copying lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:25:45,662 copying lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:25:45,664 copying lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:25:45,667 copying lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:25:45,670 copying lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:25:45,673 copying lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:25:45,676 copying lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:25:45,679 copying lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-02-14T10:25:45,682 copying lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:25:45,685 copying lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:25:45,688 copying lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:25:45,690 copying lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:25:45,693 copying lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:25:45,696 copying lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:25:45,699 copying lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:25:45,702 copying lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:25:45,705 copying lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:25:45,708 copying lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:25:45,711 copying lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:25:45,714 copying lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:25:45,717 copying lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:25:45,721 copying lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:25:45,724 copying lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:25:45,728 copying lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:25:45,730 copying lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:25:45,734 copying lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:25:45,736 copying lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:25:45,739 copying lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:25:45,742 copying lm_eval/tasks/include/few_shot_en/North Macedonian/_north macedonian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:25:45,745 copying lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:25:45,748 copying lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:25:45,751 copying lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-02-14T10:25:45,755 copying lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:25:45,758 copying lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:25:45,761 copying lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:25:45,763 copying lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:25:45,767 copying lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:25:45,770 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:25:45,773 copying lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:25:45,776 copying lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:25:45,779 copying lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:25:45,782 copying lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:25:45,785 copying lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-02-14T10:25:45,788 copying lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:25:45,791 copying lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:25:45,794 copying lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:25:45,796 copying lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:25:45,799 copying lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:25:45,802 copying lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:25:45,806 copying lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:25:45,809 copying lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:25:45,812 copying lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-02-14T10:25:45,815 copying lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:25:45,818 copying lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:25:45,821 copying lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:25:45,824 copying lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:25:45,827 copying lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:25:45,829 copying lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:25:45,833 copying lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:25:45,835 copying lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:25:45,838 copying lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:25:45,841 copying lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:25:45,844 copying lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:25:45,847 copying lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:25:45,850 copying lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:25:45,854 copying lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:25:45,858 copying lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:25:45,861 copying lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:25:45,863 copying lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:25:45,866 copying lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:25:45,870 copying lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:25:45,873 copying lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:25:45,876 copying lm_eval/tasks/include/few_shot_og/North Macedonian/_north macedonian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:25:45,879 copying lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:25:45,882 copying lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:25:45,885 copying lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-02-14T10:25:45,888 copying lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:25:45,891 copying lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:25:45,894 copying lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:25:45,897 copying lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:25:45,900 copying lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:25:45,903 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:25:45,906 copying lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:25:45,909 copying lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:45,912 copying lm_eval/tasks/mmlu_pro/README.md -> build/lib/lm_eval/tasks/mmlu_pro 2026-02-14T10:25:45,916 copying lm_eval/tasks/mmlu-pro-plus/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:45,918 copying lm_eval/tasks/mmlu-pro-plus/README.md -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:25:45,921 copying lm_eval/tasks/winogrande/README.md -> build/lib/lm_eval/tasks/winogrande 2026-02-14T10:25:45,924 copying lm_eval/tasks/agieval/README.md -> build/lib/lm_eval/tasks/agieval 2026-02-14T10:25:45,929 copying lm_eval/tasks/arab_culture/README.md -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:45,932 copying lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml -> build/lib/lm_eval/tasks/arab_culture 2026-02-14T10:25:45,934 copying lm_eval/tasks/humaneval/README.md -> build/lib/lm_eval/tasks/humaneval 2026-02-14T10:25:45,938 copying lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:45,940 copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:45,943 copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:25:45,946 copying lm_eval/tasks/okapi/arc_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:45,949 copying lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:25:45,953 copying lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:25:45,956 copying lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:45,959 copying lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:25:45,961 copying lm_eval/tasks/turblimp/README.md -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:45,963 copying lm_eval/tasks/turblimp/_template_yaml -> build/lib/lm_eval/tasks/turblimp 2026-02-14T10:25:45,965 copying lm_eval/tasks/blimp/README.md -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:45,968 copying lm_eval/tasks/blimp/_template_yaml -> build/lib/lm_eval/tasks/blimp 2026-02-14T10:25:45,971 copying lm_eval/tasks/storycloze/README.md -> build/lib/lm_eval/tasks/storycloze 2026-02-14T10:25:45,974 copying lm_eval/tasks/multiblimp/README.md -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:45,976 copying lm_eval/tasks/multiblimp/_template_yaml -> build/lib/lm_eval/tasks/multiblimp 2026-02-14T10:25:45,979 copying lm_eval/tasks/drop/README.md -> build/lib/lm_eval/tasks/drop 2026-02-14T10:25:45,982 copying lm_eval/tasks/bbq/README.md -> build/lib/lm_eval/tasks/bbq 2026-02-14T10:25:45,985 copying lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:45,987 copying lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:45,990 copying lm_eval/tasks/catalan_bench/README.md -> build/lib/lm_eval/tasks/catalan_bench 2026-02-14T10:25:45,994 copying lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:25:45,997 copying lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-02-14T10:25:46,000 copying lm_eval/tasks/portuguese_bench/README.md -> build/lib/lm_eval/tasks/portuguese_bench 2026-02-14T10:25:46,004 copying lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:25:46,006 copying lm_eval/tasks/wmdp/_default_template_yaml -> build/lib/lm_eval/tasks/wmdp 2026-02-14T10:25:46,008 copying lm_eval/tasks/wmdp/README.md -> build/lib/lm_eval/tasks/wmdp 2026-02-14T10:25:46,011 copying lm_eval/tasks/graphwalks/README.md -> build/lib/lm_eval/tasks/graphwalks 2026-02-14T10:25:46,014 copying lm_eval/tasks/lambada_multilingual/README.md -> build/lib/lm_eval/tasks/lambada_multilingual 2026-02-14T10:25:46,017 copying lm_eval/tasks/gpqa/README.md -> build/lib/lm_eval/tasks/gpqa 2026-02-14T10:25:46,020 copying lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:25:46,023 copying lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-02-14T10:25:46,027 copying lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:25:46,031 copying lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-02-14T10:25:46,035 copying lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:25:46,039 copying lm_eval/tasks/bear/README.md -> build/lib/lm_eval/tasks/bear 2026-02-14T10:25:46,041 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:46,043 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:46,046 copying lm_eval/tasks/truthfulqa-multi/README.md -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:25:46,049 copying lm_eval/tasks/careqa/README.md -> build/lib/lm_eval/tasks/careqa 2026-02-14T10:25:46,053 copying lm_eval/tasks/afrimmlu/fewshot.sh -> build/lib/lm_eval/tasks/afrimmlu 2026-02-14T10:25:46,056 copying lm_eval/tasks/afrimmlu/README.md -> build/lib/lm_eval/tasks/afrimmlu 2026-02-14T10:25:46,059 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:25:46,062 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:25:46,065 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:25:46,067 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:25:46,070 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:25:46,072 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:25:46,075 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:25:46,078 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:25:46,081 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:25:46,084 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:25:46,088 copying lm_eval/tasks/galician_bench/README.md -> build/lib/lm_eval/tasks/galician_bench 2026-02-14T10:25:46,092 copying lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:25:46,094 copying lm_eval/tasks/french_bench/_default_template_yaml -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:46,097 copying lm_eval/tasks/french_bench/README.md -> build/lib/lm_eval/tasks/french_bench 2026-02-14T10:25:46,101 copying lm_eval/tasks/blimp_nl/README.md -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:46,103 copying lm_eval/tasks/blimp_nl/_template_yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-02-14T10:25:46,106 copying lm_eval/tasks/darija_bench/README.md -> build/lib/lm_eval/tasks/darija_bench 2026-02-14T10:25:46,109 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:25:46,111 copying lm_eval/tasks/darija_bench/darija_transliteration/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:25:46,114 copying lm_eval/tasks/darija_bench/darija_summarization/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:25:46,117 copying lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:25:46,120 copying lm_eval/tasks/darija_bench/darija_sentiment/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:25:46,122 copying lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:25:46,126 copying lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:46,128 copying lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:46,131 copying lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:46,133 copying lm_eval/tasks/darija_bench/darija_translation/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:46,135 copying lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:46,138 copying lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:25:46,141 copying lm_eval/tasks/groundcocoa/README.md -> build/lib/lm_eval/tasks/groundcocoa 2026-02-14T10:25:46,144 copying lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:46,146 copying lm_eval/tasks/med_concepts_qa/README.md -> build/lib/lm_eval/tasks/med_concepts_qa 2026-02-14T10:25:46,149 copying lm_eval/tasks/polemo2/README.md -> build/lib/lm_eval/tasks/polemo2 2026-02-14T10:25:46,152 copying lm_eval/tasks/asdiv/README.md -> build/lib/lm_eval/tasks/asdiv 2026-02-14T10:25:46,154 copying lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/lib/lm_eval/tasks/xwinograd 2026-02-14T10:25:46,157 copying lm_eval/tasks/xwinograd/README.md -> build/lib/lm_eval/tasks/xwinograd 2026-02-14T10:25:46,160 copying lm_eval/tasks/mathqa/README.md -> build/lib/lm_eval/tasks/mathqa 2026-02-14T10:25:46,164 copying lm_eval/tasks/longbench/README.md -> build/lib/lm_eval/tasks/longbench 2026-02-14T10:25:46,169 copying lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:25:46,172 creating build/lib/lm_eval/tasks/model_written_evals/winogenerated 2026-02-14T10:25:46,173 copying lm_eval/tasks/model_written_evals/winogenerated/winogenerated -> build/lib/lm_eval/tasks/model_written_evals/winogenerated 2026-02-14T10:25:46,176 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:25:46,179 copying lm_eval/tasks/belebele/_default_template_yaml -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:46,181 copying lm_eval/tasks/belebele/README.md -> build/lib/lm_eval/tasks/belebele 2026-02-14T10:25:46,184 copying lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:25:46,187 copying lm_eval/tasks/mmlu-redux/generative/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:46,189 copying lm_eval/tasks/mmlu-redux/generative/README.md -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:25:46,192 copying lm_eval/tasks/olaph/README.md -> build/lib/lm_eval/tasks/olaph 2026-02-14T10:25:46,195 copying lm_eval/tasks/discrim_eval/README.md -> build/lib/lm_eval/tasks/discrim_eval 2026-02-14T10:25:46,198 copying lm_eval/tasks/libra/README.md -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:46,201 copying lm_eval/tasks/libra/_template_yaml -> build/lib/lm_eval/tasks/libra 2026-02-14T10:25:46,203 copying lm_eval/tasks/mmmu/README.md -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:46,206 copying lm_eval/tasks/mmmu/_template_yaml -> build/lib/lm_eval/tasks/mmmu 2026-02-14T10:25:46,210 copying lm_eval/tasks/pisa/README.md -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:46,212 copying lm_eval/tasks/pisa/_template_yaml -> build/lib/lm_eval/tasks/pisa 2026-02-14T10:25:46,215 copying lm_eval/tasks/mela/README.md -> build/lib/lm_eval/tasks/mela 2026-02-14T10:25:46,217 copying lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/lib/lm_eval/tasks/csatqa 2026-02-14T10:25:46,221 copying lm_eval/tasks/chartqa/README.md -> build/lib/lm_eval/tasks/chartqa 2026-02-14T10:25:46,224 copying lm_eval/tasks/cnn_dailymail/README.md -> build/lib/lm_eval/tasks/cnn_dailymail 2026-02-14T10:25:46,227 copying lm_eval/tasks/xnli/README.md -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:46,230 copying lm_eval/tasks/xnli/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli 2026-02-14T10:25:46,234 copying lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/lib/lm_eval/tasks/bigbench 2026-02-14T10:25:46,236 copying lm_eval/tasks/bigbench/README.md -> build/lib/lm_eval/tasks/bigbench 2026-02-14T10:25:46,239 copying lm_eval/tasks/bigbench/generate_until_template_yaml -> build/lib/lm_eval/tasks/bigbench 2026-02-14T10:25:46,241 copying lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/lib/lm_eval/tasks/bigbench 2026-02-14T10:25:46,244 copying lm_eval/tasks/babilong/README.md -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:46,247 copying lm_eval/tasks/babilong/_babilong_common_yaml -> build/lib/lm_eval/tasks/babilong 2026-02-14T10:25:46,249 copying lm_eval/tasks/mmlu_prox/README.md -> build/lib/lm_eval/tasks/mmlu_prox 2026-02-14T10:25:46,254 copying lm_eval/tasks/mmlu_prox/it/_it_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:46,257 copying lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:25:46,259 copying lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:46,261 copying lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:25:46,264 copying lm_eval/tasks/mmlu_prox/af/_af_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:46,267 copying lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:25:46,270 copying lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:46,273 copying lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:25:46,275 copying lm_eval/tasks/mmlu_prox/th/_th_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:46,278 copying lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:25:46,281 copying lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:46,283 copying lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:25:46,286 copying lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:46,289 copying lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:25:46,292 copying lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:46,294 copying lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:25:46,298 copying lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:46,300 copying lm_eval/tasks/mmlu_prox/es/_es_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:25:46,304 copying lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:46,306 copying lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:25:46,310 copying lm_eval/tasks/mmlu_prox/template/_lang_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/template 2026-02-14T10:25:46,312 copying lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:46,315 copying lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:25:46,318 copying lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:46,320 copying lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:25:46,323 copying lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:46,326 copying lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:25:46,329 copying lm_eval/tasks/mmlu_prox/id/_id_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:46,331 copying lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:25:46,334 copying lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:46,336 copying lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:25:46,340 copying lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:46,342 copying lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:25:46,345 copying lm_eval/tasks/mmlu_prox/de/_de_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:46,364 copying lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:25:46,366 copying lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:46,368 copying lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:25:46,371 copying lm_eval/tasks/mmlu_prox/en/_en_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:46,373 copying lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:25:46,376 copying lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:46,378 copying lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:25:46,381 copying lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:46,383 copying lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:25:46,386 copying lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:46,389 copying lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:25:46,391 copying lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:46,394 copying lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:25:46,397 copying lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:46,399 copying lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:25:46,402 copying lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:46,405 copying lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:25:46,407 copying lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:46,409 copying lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:25:46,412 copying lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:46,414 copying lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:25:46,417 copying lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:46,420 copying lm_eval/tasks/mmlu_prox/te/_te_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:25:46,422 copying lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:46,425 copying lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:25:46,428 copying lm_eval/tasks/tmmluplus/README.md -> build/lib/lm_eval/tasks/tmmluplus 2026-02-14T10:25:46,430 copying lm_eval/tasks/tmmluplus/subject.tsv -> build/lib/lm_eval/tasks/tmmluplus 2026-02-14T10:25:46,433 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-02-14T10:25:46,436 copying lm_eval/tasks/eus_exams/eus_exams_eu -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:46,439 copying lm_eval/tasks/eus_exams/README.md -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:46,442 copying lm_eval/tasks/eus_exams/eus_exams_es -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:46,444 copying lm_eval/tasks/eus_exams/eus_exams -> build/lib/lm_eval/tasks/eus_exams 2026-02-14T10:25:46,448 copying lm_eval/tasks/afrimgsm/run.sh -> build/lib/lm_eval/tasks/afrimgsm 2026-02-14T10:25:46,451 copying lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/afrimgsm 2026-02-14T10:25:46,453 copying lm_eval/tasks/afrimgsm/README.md -> build/lib/lm_eval/tasks/afrimgsm 2026-02-14T10:25:46,456 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:25:46,458 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:25:46,460 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:25:46,462 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:25:46,464 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:25:46,466 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:25:46,469 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:25:46,471 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:25:46,473 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:25:46,475 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:25:46,478 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:25:46,480 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:25:46,482 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:25:46,485 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:25:46,487 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:25:46,490 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:25:46,492 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:25:46,495 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:25:46,497 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:25:46,500 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:25:46,502 copying lm_eval/tasks/coqa/README.md -> build/lib/lm_eval/tasks/coqa 2026-02-14T10:25:46,505 copying lm_eval/tasks/esbbq/README.md -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:46,507 copying lm_eval/tasks/esbbq/_esbbq_common_yaml -> build/lib/lm_eval/tasks/esbbq 2026-02-14T10:25:46,510 copying lm_eval/tasks/mbpp/README.md -> build/lib/lm_eval/tasks/mbpp 2026-02-14T10:25:46,513 copying lm_eval/tasks/nq_open/README.md -> build/lib/lm_eval/tasks/nq_open 2026-02-14T10:25:46,515 copying lm_eval/tasks/aime/README.md -> build/lib/lm_eval/tasks/aime 2026-02-14T10:25:46,518 copying lm_eval/tasks/arithmetic/README.md -> build/lib/lm_eval/tasks/arithmetic 2026-02-14T10:25:46,521 copying lm_eval/tasks/noticia/README.md -> build/lib/lm_eval/tasks/noticia 2026-02-14T10:25:46,524 copying lm_eval/tasks/openai-mmmlu/languages.json -> build/lib/lm_eval/tasks/openai-mmmlu 2026-02-14T10:25:46,526 copying lm_eval/tasks/openai-mmmlu/README.md -> build/lib/lm_eval/tasks/openai-mmmlu 2026-02-14T10:25:46,529 copying lm_eval/tasks/openai-mmmlu/subjects.json -> build/lib/lm_eval/tasks/openai-mmmlu 2026-02-14T10:25:46,532 copying lm_eval/tasks/openai-mmmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:25:46,536 copying lm_eval/tasks/kormedmcqa/README.md -> build/lib/lm_eval/tasks/kormedmcqa 2026-02-14T10:25:46,538 copying lm_eval/tasks/kormedmcqa/_template_yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-02-14T10:25:46,541 copying lm_eval/tasks/wmt2016/README.md -> build/lib/lm_eval/tasks/wmt2016 2026-02-14T10:25:46,544 copying lm_eval/tasks/fld/README.md -> build/lib/lm_eval/tasks/fld 2026-02-14T10:25:46,547 copying lm_eval/tasks/squad_completion/README.md -> build/lib/lm_eval/tasks/squad_completion 2026-02-14T10:25:46,550 copying lm_eval/tasks/hrm8k/README.md -> build/lib/lm_eval/tasks/hrm8k 2026-02-14T10:25:46,552 copying lm_eval/tasks/hrm8k/default/_hrm8k_yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-02-14T10:25:46,556 copying lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-02-14T10:25:46,559 copying lm_eval/tasks/mlqa/mlqa_common_yaml -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:46,561 copying lm_eval/tasks/mlqa/README.md -> build/lib/lm_eval/tasks/mlqa 2026-02-14T10:25:46,564 copying lm_eval/tasks/llama3/README.md -> build/lib/lm_eval/tasks/llama3 2026-02-14T10:25:46,567 copying lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:25:46,570 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:25:46,574 copying lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:25:46,577 copying lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:25:46,580 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:25:46,583 copying lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:25:46,587 copying lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:25:46,591 copying lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:25:46,593 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:25:46,595 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:25:46,598 copying lm_eval/tasks/aradice/README.md -> build/lib/lm_eval/tasks/aradice 2026-02-14T10:25:46,607 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:25:46,610 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:25:46,622 copying lm_eval/tasks/c4/README.md -> build/lib/lm_eval/tasks/c4 2026-02-14T10:25:46,625 copying lm_eval/tasks/truthfulqa/README.md -> build/lib/lm_eval/tasks/truthfulqa 2026-02-14T10:25:46,628 copying lm_eval/tasks/mgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/mgsm 2026-02-14T10:25:46,630 copying lm_eval/tasks/mgsm/README.md -> build/lib/lm_eval/tasks/mgsm 2026-02-14T10:25:46,633 copying lm_eval/tasks/mgsm/direct/direct_yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-02-14T10:25:46,635 copying lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:25:46,637 copying lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:25:46,640 copying lm_eval/tasks/global_mmlu/README.md -> build/lib/lm_eval/tasks/global_mmlu 2026-02-14T10:25:46,643 copying lm_eval/tasks/global_mmlu/default/it/_it_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:25:46,646 copying lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:25:46,649 copying lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:25:46,652 copying lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:25:46,654 copying lm_eval/tasks/global_mmlu/default/es/_es_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:25:46,657 copying lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:25:46,660 copying lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:25:46,663 copying lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:25:46,667 copying lm_eval/tasks/global_mmlu/default/id/_id_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:25:46,670 copying lm_eval/tasks/global_mmlu/default/de/_de_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:25:46,673 copying lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:25:46,676 copying lm_eval/tasks/global_mmlu/default/en/_en_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:25:46,679 copying lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:25:46,682 copying lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:25:46,685 copying lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:25:46,688 copying lm_eval/tasks/global_mmlu/full/it/_it_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:25:46,691 copying lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:25:46,694 copying lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:25:46,697 copying lm_eval/tasks/global_mmlu/full/so/_so_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:25:46,701 copying lm_eval/tasks/global_mmlu/full/el/_el_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:25:46,703 copying lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:25:46,707 copying lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:25:46,710 copying lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:25:46,713 copying lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:25:46,716 copying lm_eval/tasks/global_mmlu/full/es/_es_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:25:46,718 copying lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:25:46,721 copying lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:25:46,724 copying lm_eval/tasks/global_mmlu/full/he/_he_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:25:46,727 copying lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:25:46,730 copying lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:25:46,733 copying lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:25:46,736 copying lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:25:46,739 copying lm_eval/tasks/global_mmlu/full/si/_si_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:25:46,742 copying lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:25:46,746 copying lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:25:46,749 copying lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:25:46,752 copying lm_eval/tasks/global_mmlu/full/am/_am_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:25:46,755 copying lm_eval/tasks/global_mmlu/full/id/_id_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:25:46,758 copying lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:25:46,761 copying lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:25:46,764 copying lm_eval/tasks/global_mmlu/full/de/_de_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:25:46,767 copying lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:25:46,770 copying lm_eval/tasks/global_mmlu/full/en/_en_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:25:46,773 copying lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:25:46,777 copying lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:25:46,780 copying lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:25:46,783 copying lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:25:46,786 copying lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:25:46,789 copying lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:25:46,792 copying lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:25:46,795 copying lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:25:46,799 copying lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:25:46,802 copying lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:25:46,805 copying lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:25:46,808 copying lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:25:46,811 copying lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:25:46,813 copying lm_eval/tasks/global_mmlu/full/te/_te_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:25:46,816 copying lm_eval/tasks/mmlu/README.md -> build/lib/lm_eval/tasks/mmlu 2026-02-14T10:25:46,819 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:46,821 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:25:46,827 copying lm_eval/tasks/mmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-02-14T10:25:46,829 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:25:46,832 copying lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-02-14T10:25:46,836 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:25:46,838 copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:25:46,841 copying lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-02-14T10:25:46,843 copying lm_eval/tasks/triviaqa/README.md -> build/lib/lm_eval/tasks/triviaqa 2026-02-14T10:25:46,845 copying lm_eval/tasks/mmlu-redux-spanish/README.md -> build/lib/lm_eval/tasks/mmlu-redux-spanish 2026-02-14T10:25:46,848 copying lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:25:46,850 copying lm_eval/tasks/xcopa/README.md -> build/lib/lm_eval/tasks/xcopa 2026-02-14T10:25:46,854 copying lm_eval/tasks/tinyBenchmarks/README.md -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:25:46,859 copying lm_eval/tasks/logiqa/README.md -> build/lib/lm_eval/tasks/logiqa 2026-02-14T10:25:46,862 copying lm_eval/tasks/icelandic_winogrande/README.md -> build/lib/lm_eval/tasks/icelandic_winogrande 2026-02-14T10:25:46,866 copying lm_eval/tasks/arc/README.md -> build/lib/lm_eval/tasks/arc 2026-02-14T10:25:46,872 copying lm_eval/tasks/darijammlu/README.md -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:47,100 copying lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml -> build/lib/lm_eval/tasks/darijammlu 2026-02-14T10:25:47,105 copying lm_eval/tasks/histoires_morales/README.md -> build/lib/lm_eval/tasks/histoires_morales 2026-02-14T10:25:47,111 copying lm_eval/tasks/slr_bench/README.md -> build/lib/lm_eval/tasks/slr_bench 2026-02-14T10:25:47,114 copying lm_eval/tasks/slr_bench/slr_bench_common_yaml -> build/lib/lm_eval/tasks/slr_bench 2026-02-14T10:25:47,119 copying lm_eval/tasks/benchmarks/README.md -> build/lib/lm_eval/tasks/benchmarks 2026-02-14T10:25:47,123 copying lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2026-02-14T10:25:47,126 copying lm_eval/tasks/benchmarks/multimedqa/README.md -> build/lib/lm_eval/tasks/benchmarks/multimedqa 2026-02-14T10:25:47,130 copying lm_eval/tasks/eus_reading/README.md -> build/lib/lm_eval/tasks/eus_reading 2026-02-14T10:25:47,136 copying lm_eval/tasks/click/README.md -> build/lib/lm_eval/tasks/click 2026-02-14T10:25:47,140 copying lm_eval/tasks/click/click_cul/_default_click_cul_yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-02-14T10:25:47,145 copying lm_eval/tasks/click/click_lang/_default_click_lang_yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-02-14T10:25:47,151 copying lm_eval/tasks/unscramble/README.md -> build/lib/lm_eval/tasks/unscramble 2026-02-14T10:25:47,156 copying lm_eval/tasks/paloma/_paloma_template -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:47,160 copying lm_eval/tasks/paloma/README.md -> build/lib/lm_eval/tasks/paloma 2026-02-14T10:25:47,164 copying lm_eval/tasks/commonsense_qa/README.md -> build/lib/lm_eval/tasks/commonsense_qa 2026-02-14T10:25:47,167 copying lm_eval/tasks/darijahellaswag/README.md -> build/lib/lm_eval/tasks/darijahellaswag 2026-02-14T10:25:47,172 copying lm_eval/tasks/cabbq/_cabbq_common_yaml -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:47,175 copying lm_eval/tasks/cabbq/README.md -> build/lib/lm_eval/tasks/cabbq 2026-02-14T10:25:47,182 copying lm_eval/tasks/metabench/README.md -> build/lib/lm_eval/tasks/metabench 2026-02-14T10:25:47,187 copying lm_eval/tasks/pile_10k/README.md -> build/lib/lm_eval/tasks/pile_10k 2026-02-14T10:25:47,191 copying lm_eval/tasks/minerva_math/README.md -> build/lib/lm_eval/tasks/minerva_math 2026-02-14T10:25:47,197 copying lm_eval/tasks/bertaqa/_bertaqa_template -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:47,200 copying lm_eval/tasks/bertaqa/README.md -> build/lib/lm_eval/tasks/bertaqa 2026-02-14T10:25:47,205 copying lm_eval/tasks/ifeval/README.md -> build/lib/lm_eval/tasks/ifeval 2026-02-14T10:25:47,215 copying lm_eval/tasks/mc_taco/README.md -> build/lib/lm_eval/tasks/mc_taco 2026-02-14T10:25:47,218 copying lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:47,222 copying lm_eval/tasks/japanese_leaderboard/README.md -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:25:47,225 copying lm_eval/tasks/xstorycloze/README.md -> build/lib/lm_eval/tasks/xstorycloze 2026-02-14T10:25:47,228 copying lm_eval/tasks/scrolls/README.md -> build/lib/lm_eval/tasks/scrolls 2026-02-14T10:25:47,230 copying lm_eval/tasks/afrobench/README.md -> build/lib/lm_eval/tasks/afrobench 2026-02-14T10:25:47,232 copying lm_eval/tasks/afrobench/nollysenti/README.md -> build/lib/lm_eval/tasks/afrobench/nollysenti 2026-02-14T10:25:47,235 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:25:47,238 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:25:47,241 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:25:47,244 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:25:47,247 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:25:47,249 copying lm_eval/tasks/afrobench/masakhanews/README.md -> build/lib/lm_eval/tasks/afrobench/masakhanews 2026-02-14T10:25:47,253 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:25:47,256 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:25:47,259 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:25:47,262 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:25:47,265 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:25:47,268 copying lm_eval/tasks/afrobench/uhura-arc-easy/README.md -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-02-14T10:25:47,271 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:25:47,274 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:25:47,277 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:25:47,280 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:25:47,282 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:25:47,285 copying lm_eval/tasks/afrobench/openai_mmlu/README.md -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-02-14T10:25:47,288 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-02-14T10:25:47,290 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-02-14T10:25:47,292 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-02-14T10:25:47,295 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-02-14T10:25:47,297 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-02-14T10:25:47,300 copying lm_eval/tasks/afrobench/adr/README.md -> build/lib/lm_eval/tasks/afrobench/adr 2026-02-14T10:25:47,302 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:25:47,305 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:25:47,307 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:25:47,309 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:25:47,311 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:25:47,314 copying lm_eval/tasks/afrobench/masakhaner/README.md -> build/lib/lm_eval/tasks/afrobench/masakhaner 2026-02-14T10:25:47,317 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:25:47,320 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:25:47,323 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:25:47,326 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:25:47,329 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:25:47,332 copying lm_eval/tasks/afrobench/naijarc/README.md -> build/lib/lm_eval/tasks/afrobench/naijarc 2026-02-14T10:25:47,335 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-02-14T10:25:47,337 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-02-14T10:25:47,340 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-02-14T10:25:47,342 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-02-14T10:25:47,344 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-02-14T10:25:47,347 copying lm_eval/tasks/afrobench/ntrex/README.md -> build/lib/lm_eval/tasks/afrobench/ntrex 2026-02-14T10:25:47,350 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:25:47,352 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:25:47,354 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:25:47,358 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:25:47,361 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:25:47,363 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:25:47,366 copying lm_eval/tasks/afrobench/salt/README.md -> build/lib/lm_eval/tasks/afrobench/salt 2026-02-14T10:25:47,368 copying lm_eval/tasks/afrobench/salt/prompt_1/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:25:47,370 copying lm_eval/tasks/afrobench/salt/prompt_2/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:25:47,373 copying lm_eval/tasks/afrobench/salt/prompt_3/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:25:47,376 copying lm_eval/tasks/afrobench/flores/README.md -> build/lib/lm_eval/tasks/afrobench/flores 2026-02-14T10:25:47,378 copying lm_eval/tasks/afrobench/flores/prompt_1/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1 2026-02-14T10:25:47,381 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:25:47,383 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:25:47,386 copying lm_eval/tasks/afrobench/flores/prompt_2/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2 2026-02-14T10:25:47,388 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:25:47,390 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:25:47,393 copying lm_eval/tasks/afrobench/flores/prompt_3/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3 2026-02-14T10:25:47,395 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:25:47,397 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:25:47,399 copying lm_eval/tasks/afrobench/belebele/README.md -> build/lib/lm_eval/tasks/afrobench/belebele 2026-02-14T10:25:47,402 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:25:47,405 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:25:47,407 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:25:47,409 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:25:47,411 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:25:47,413 creating build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2026-02-14T10:25:47,415 copying lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh -> build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2026-02-14T10:25:47,417 copying lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh -> build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2026-02-14T10:25:47,420 copying lm_eval/tasks/afrobench/mafand/README.md -> build/lib/lm_eval/tasks/afrobench/mafand 2026-02-14T10:25:47,423 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:25:47,426 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:25:47,429 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:25:47,431 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:25:47,434 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:25:47,437 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:25:47,441 copying lm_eval/tasks/afrobench/injongointent/README.md -> build/lib/lm_eval/tasks/afrobench/injongointent 2026-02-14T10:25:47,443 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:25:47,446 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:25:47,449 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:25:47,452 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:25:47,456 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:25:47,459 copying lm_eval/tasks/afrobench/afrisenti/fewshot.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-02-14T10:25:47,462 copying lm_eval/tasks/afrobench/afrisenti/README.md -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-02-14T10:25:47,465 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:47,468 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:25:47,471 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:25:47,475 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:47,477 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:25:47,481 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:25:47,484 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:25:47,488 copying lm_eval/tasks/afrobench/sib/README.md -> build/lib/lm_eval/tasks/afrobench/sib 2026-02-14T10:25:47,491 copying lm_eval/tasks/afrobench/sib/prompt_1/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:25:47,494 copying lm_eval/tasks/afrobench/sib/prompt_5/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:25:47,497 copying lm_eval/tasks/afrobench/sib/prompt_2/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:25:47,500 copying lm_eval/tasks/afrobench/sib/prompt_3/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:25:47,503 copying lm_eval/tasks/afrobench/sib/prompt_4/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:25:47,506 copying lm_eval/tasks/afrobench/xlsum/README.md -> build/lib/lm_eval/tasks/afrobench/xlsum 2026-02-14T10:25:47,509 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:25:47,512 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:25:47,515 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:25:47,517 copying lm_eval/tasks/afrobench/afriqa/README.md -> build/lib/lm_eval/tasks/afrobench/afriqa 2026-02-14T10:25:47,520 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:25:47,523 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:25:47,526 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:25:47,529 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:25:47,532 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:25:47,535 copying lm_eval/tasks/afrobench/masakhapos/README.md -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-02-14T10:25:47,538 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:25:47,541 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:25:47,543 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:25:47,546 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:25:47,549 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:25:47,556 copying lm_eval/tasks/ruler/README.md -> build/lib/lm_eval/tasks/ruler 2026-02-14T10:25:47,559 copying lm_eval/tasks/pile/README.md -> build/lib/lm_eval/tasks/pile 2026-02-14T10:25:47,562 copying lm_eval/tasks/arab_culture_completion/README.md -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:47,566 copying lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-02-14T10:25:47,568 copying lm_eval/tasks/basqueglue/README.md -> build/lib/lm_eval/tasks/basqueglue 2026-02-14T10:25:47,571 copying lm_eval/tasks/global_piqa/README.md -> build/lib/lm_eval/tasks/global_piqa 2026-02-14T10:25:47,574 copying lm_eval/tasks/global_piqa/prompted/_template -> build/lib/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:25:47,576 copying lm_eval/tasks/global_piqa/completions/_template -> build/lib/lm_eval/tasks/global_piqa/completions 2026-02-14T10:25:47,580 copying lm_eval/tasks/unitxt/unitxt_multimodal -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:47,582 copying lm_eval/tasks/unitxt/README.md -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:47,584 copying lm_eval/tasks/unitxt/unitxt -> build/lib/lm_eval/tasks/unitxt 2026-02-14T10:25:47,586 copying lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_complete 2026-02-14T10:25:47,600 copying lm_eval/tasks/logiqa2/README.md -> build/lib/lm_eval/tasks/logiqa2 2026-02-14T10:25:47,603 copying lm_eval/tasks/super_glue/README.md -> build/lib/lm_eval/tasks/super_glue 2026-02-14T10:25:47,611 copying lm_eval/tasks/lingoly/README.md -> build/lib/lm_eval/tasks/lingoly 2026-02-14T10:25:47,614 copying lm_eval/tasks/pubmedqa/README.md -> build/lib/lm_eval/tasks/pubmedqa 2026-02-14T10:25:47,618 copying lm_eval/tasks/meddialog/README.md -> build/lib/lm_eval/tasks/meddialog 2026-02-14T10:25:47,621 copying lm_eval/tasks/squadv2/README.md -> build/lib/lm_eval/tasks/squadv2 2026-02-14T10:25:47,624 copying lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-02-14T10:25:47,626 copying lm_eval/tasks/hendrycks_ethics/README.md -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-02-14T10:25:47,629 copying lm_eval/tasks/cmmlu/_default_template_yaml -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:47,631 copying lm_eval/tasks/cmmlu/README.md -> build/lib/lm_eval/tasks/cmmlu 2026-02-14T10:25:47,634 copying lm_eval/tasks/afrixnli/README.md -> build/lib/lm_eval/tasks/afrixnli 2026-02-14T10:25:47,637 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:25:47,640 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:25:47,643 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:25:47,646 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:25:47,648 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:25:47,651 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:25:47,654 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:25:47,658 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:25:47,660 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:25:47,663 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:25:47,666 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:25:47,669 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:25:47,672 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:25:47,675 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:25:47,678 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:25:47,680 copying lm_eval/tasks/siqa/README.md -> build/lib/lm_eval/tasks/siqa 2026-02-14T10:25:47,682 copying lm_eval/tasks/egyhellaswag/README.md -> build/lib/lm_eval/tasks/egyhellaswag 2026-02-14T10:25:47,685 copying lm_eval/tasks/gsm8k_platinum/README.md -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-02-14T10:25:47,687 copying lm_eval/tasks/aexams/_default_template_yaml -> build/lib/lm_eval/tasks/aexams 2026-02-14T10:25:47,689 copying lm_eval/tasks/aexams/README.md -> build/lib/lm_eval/tasks/aexams 2026-02-14T10:25:47,692 copying lm_eval/tasks/toxigen/README.md -> build/lib/lm_eval/tasks/toxigen 2026-02-14T10:25:56,870 installing to build/bdist.linux-armv7l/wheel 2026-02-14T10:25:56,871 running install 2026-02-14T10:25:56,894 running install_lib 2026-02-14T10:25:56,899 creating build/bdist.linux-armv7l/wheel 2026-02-14T10:25:56,902 creating build/bdist.linux-armv7l/wheel/lm_eval 2026-02-14T10:25:56,903 creating build/bdist.linux-armv7l/wheel/lm_eval/prompts 2026-02-14T10:25:56,905 copying build/lib/lm_eval/prompts/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/prompts 2026-02-14T10:25:56,907 creating build/bdist.linux-armv7l/wheel/lm_eval/filters 2026-02-14T10:25:56,909 copying build/lib/lm_eval/filters/custom.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-02-14T10:25:56,910 copying build/lib/lm_eval/filters/decontamination.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-02-14T10:25:56,912 copying build/lib/lm_eval/filters/selection.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-02-14T10:25:56,914 copying build/lib/lm_eval/filters/transformation.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-02-14T10:25:56,916 copying build/lib/lm_eval/filters/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-02-14T10:25:56,917 copying build/lib/lm_eval/filters/extraction.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-02-14T10:25:56,920 copying build/lib/lm_eval/defaults.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-02-14T10:25:56,922 copying build/lib/lm_eval/evaluator.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-02-14T10:25:56,925 creating build/bdist.linux-armv7l/wheel/lm_eval/loggers 2026-02-14T10:25:56,926 copying build/lib/lm_eval/loggers/wandb_logger.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-02-14T10:25:56,929 copying build/lib/lm_eval/loggers/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-02-14T10:25:56,931 copying build/lib/lm_eval/loggers/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-02-14T10:25:56,933 copying build/lib/lm_eval/loggers/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-02-14T10:25:56,935 copying build/lib/lm_eval/evaluator_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-02-14T10:25:56,941 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks 2026-02-14T10:25:56,943 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/copal_id 2026-02-14T10:25:56,944 copying build/lib/lm_eval/tasks/copal_id/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-02-14T10:25:56,946 copying build/lib/lm_eval/tasks/copal_id/standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-02-14T10:25:56,948 copying build/lib/lm_eval/tasks/copal_id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-02-14T10:25:56,950 copying build/lib/lm_eval/tasks/copal_id/colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-02-14T10:25:56,952 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval 2026-02-14T10:25:56,953 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norrewrite-instruct 2026-02-14T10:25:56,955 copying build/lib/lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norrewrite-instruct 2026-02-14T10:25:56,957 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:56,958 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:56,960 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:56,962 copying build/lib/lm_eval/tasks/noreval/ask_gec/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:56,963 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:56,965 copying build/lib/lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:56,967 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:56,968 copying build/lib/lm_eval/tasks/noreval/ask_gec/errant.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:56,970 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-02-14T10:25:56,972 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/ncb 2026-02-14T10:25:56,973 copying build/lib/lm_eval/tasks/noreval/ncb/ncb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ncb 2026-02-14T10:25:56,975 copying build/lib/lm_eval/tasks/noreval/noreval.jpg -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval 2026-02-14T10:25:57,000 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:57,002 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:57,004 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:57,006 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:57,008 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:57,010 copying build/lib/lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:57,012 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-02-14T10:25:57,015 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec 2026-02-14T10:25:57,017 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:57,018 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:57,021 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:57,023 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:57,025 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:57,027 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-02-14T10:25:57,030 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:57,031 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:57,033 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:57,035 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:57,038 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:57,040 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-02-14T10:25:57,042 copying build/lib/lm_eval/tasks/noreval/norec/_norec_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec 2026-02-14T10:25:57,044 copying build/lib/lm_eval/tasks/noreval/norec/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec 2026-02-14T10:25:57,046 copying build/lib/lm_eval/tasks/noreval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval 2026-02-14T10:25:57,049 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm 2026-02-14T10:25:57,051 copying build/lib/lm_eval/tasks/noreval/norsumm/_norsumm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm 2026-02-14T10:25:57,053 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:57,055 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:57,057 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:57,059 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:57,061 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:57,062 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:57,064 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-02-14T10:25:57,067 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:57,068 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:57,069 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:57,071 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:57,073 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:57,075 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:57,077 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-02-14T10:25:57,079 copying build/lib/lm_eval/tasks/noreval/norsumm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm 2026-02-14T10:25:57,081 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsummarize-instruct 2026-02-14T10:25:57,082 copying build/lib/lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsummarize-instruct 2026-02-14T10:25:57,085 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba 2026-02-14T10:25:57,087 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-02-14T10:25:57,088 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-02-14T10:25:57,090 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-02-14T10:25:57,092 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-02-14T10:25:57,094 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-02-14T10:25:57,096 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-02-14T10:25:57,097 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-02-14T10:25:57,099 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-02-14T10:25:57,101 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-02-14T10:25:57,103 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-02-14T10:25:57,105 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-02-14T10:25:57,106 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-02-14T10:25:57,108 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-02-14T10:25:57,109 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-02-14T10:25:57,111 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-02-14T10:25:57,113 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-02-14T10:25:57,114 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-02-14T10:25:57,116 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-02-14T10:25:57,118 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-02-14T10:25:57,120 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-02-14T10:25:57,122 copying build/lib/lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba 2026-02-14T10:25:57,124 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa 2026-02-14T10:25:57,125 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa 2026-02-14T10:25:57,128 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:57,129 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:57,131 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:57,133 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:57,134 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:57,136 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:57,138 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-02-14T10:25:57,141 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:57,142 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:57,143 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:57,145 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:57,147 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:57,149 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:57,151 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-02-14T10:25:57,153 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa 2026-02-14T10:25:57,155 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:57,156 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:57,158 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:57,159 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:57,161 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:57,163 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-02-14T10:25:57,165 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:57,167 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:57,169 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:57,170 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:57,172 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:57,174 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-02-14T10:25:57,176 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa 2026-02-14T10:25:57,178 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa 2026-02-14T10:25:57,180 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2026-02-14T10:25:57,181 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:57,182 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:57,185 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:57,186 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:57,188 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:57,190 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:57,191 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-02-14T10:25:57,195 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:57,196 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:57,198 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:57,200 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:57,201 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:57,203 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:57,205 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-02-14T10:25:57,207 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2026-02-14T10:25:57,209 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-02-14T10:25:57,211 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:57,212 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:57,214 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:57,216 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:57,218 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:57,220 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-02-14T10:25:57,221 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation 2026-02-14T10:25:57,224 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:57,225 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:57,226 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:57,228 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:57,230 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:57,232 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-02-14T10:25:57,233 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation 2026-02-14T10:25:57,236 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom 2026-02-14T10:25:57,237 copying build/lib/lm_eval/tasks/noreval/noridiom/_noridiom_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom 2026-02-14T10:25:57,240 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:57,241 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:57,243 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:57,244 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:57,246 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:57,248 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-02-14T10:25:57,250 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:57,251 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:57,253 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:57,255 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:57,257 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:57,259 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-02-14T10:25:57,261 copying build/lib/lm_eval/tasks/noreval/noridiom/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom 2026-02-14T10:25:57,263 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa 2026-02-14T10:25:57,264 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa 2026-02-14T10:25:57,267 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:57,268 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:57,270 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:57,271 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:57,273 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:57,275 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-02-14T10:25:57,277 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:57,278 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:57,280 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:57,282 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:57,284 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:57,286 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-02-14T10:25:57,287 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa 2026-02-14T10:25:57,290 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norquad 2026-02-14T10:25:57,291 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-02-14T10:25:57,293 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-02-14T10:25:57,294 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-02-14T10:25:57,296 copying build/lib/lm_eval/tasks/noreval/norquad/_norquad_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-02-14T10:25:57,298 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-02-14T10:25:57,300 copying build/lib/lm_eval/tasks/noreval/norquad/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-02-14T10:25:57,302 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-02-14T10:25:57,304 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/prost 2026-02-14T10:25:57,305 copying build/lib/lm_eval/tasks/prost/corypaik_prost.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost 2026-02-14T10:25:57,307 copying build/lib/lm_eval/tasks/prost/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost 2026-02-14T10:25:57,309 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mimic_repsum 2026-02-14T10:25:57,311 copying build/lib/lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-02-14T10:25:57,312 copying build/lib/lm_eval/tasks/mimic_repsum/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-02-14T10:25:57,314 copying build/lib/lm_eval/tasks/mimic_repsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-02-14T10:25:57,316 copying build/lib/lm_eval/tasks/mimic_repsum/mimic_repsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-02-14T10:25:57,318 copying build/lib/lm_eval/tasks/mimic_repsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-02-14T10:25:57,321 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,322 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,323 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,325 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,327 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,328 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,331 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,332 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,334 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,336 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,337 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,339 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,341 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,343 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,344 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,346 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,348 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,350 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,351 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,353 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,355 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,357 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,358 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,360 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,362 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,364 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,365 copying build/lib/lm_eval/tasks/arabicmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,367 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,369 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,370 copying build/lib/lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,372 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,374 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,376 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,378 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,379 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,381 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,383 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,385 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,386 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,388 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,390 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,392 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,393 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,395 copying build/lib/lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,397 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,399 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,401 copying build/lib/lm_eval/tasks/arabicmmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,402 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,404 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,406 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,408 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-02-14T10:25:57,411 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,412 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,414 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,416 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,418 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,420 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,421 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,423 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,425 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,427 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,428 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,430 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,432 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,434 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,436 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,438 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,439 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,441 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,443 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,444 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,446 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,448 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,449 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,451 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,453 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,455 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,456 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,458 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,460 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,462 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,464 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,465 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,467 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,469 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,471 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,473 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,475 copying build/lib/lm_eval/tasks/lm_syneval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,477 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,480 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,481 copying build/lib/lm_eval/tasks/lm_syneval/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,483 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,485 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,486 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,488 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,490 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,492 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,493 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,495 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,497 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,499 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,501 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,502 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,504 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,506 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,508 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,509 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,511 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,513 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,515 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,517 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,518 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,520 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,522 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,523 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,525 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,527 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,529 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,530 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,532 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,534 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,536 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,538 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,539 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,541 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,543 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,545 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-02-14T10:25:57,547 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/simple_cooccurrence_bias 2026-02-14T10:25:57,548 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-02-14T10:25:57,550 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-02-14T10:25:57,552 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-02-14T10:25:57,554 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-02-14T10:25:57,557 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu 2026-02-14T10:25:57,559 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,560 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,562 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,563 copying build/lib/lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,565 copying build/lib/lm_eval/tasks/tmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,567 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,569 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,570 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,572 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,574 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,575 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,577 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,579 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,581 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,582 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,584 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,586 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,588 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,590 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,591 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,593 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,595 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,597 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,599 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,601 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,602 copying build/lib/lm_eval/tasks/tmlu/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,605 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,607 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,608 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,610 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,612 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,613 copying build/lib/lm_eval/tasks/tmlu/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,615 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,617 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,619 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,620 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-02-14T10:25:57,622 copying build/lib/lm_eval/tasks/tmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu 2026-02-14T10:25:57,624 copying build/lib/lm_eval/tasks/tmlu/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu 2026-02-14T10:25:57,626 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,627 copying build/lib/lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,629 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,631 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,633 copying build/lib/lm_eval/tasks/inverse_scaling/_some_results -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,635 copying build/lib/lm_eval/tasks/inverse_scaling/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,637 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,639 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,640 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,642 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,644 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,646 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,647 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,649 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,651 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-02-14T10:25:57,654 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu 2026-02-14T10:25:57,655 copying build/lib/lm_eval/tasks/turkishmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu 2026-02-14T10:25:57,657 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:57,659 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:57,661 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:57,663 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:57,665 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:57,667 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:57,669 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:57,672 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:57,674 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:57,676 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:57,678 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-02-14T10:25:57,681 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:57,682 copying build/lib/lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:57,684 copying build/lib/lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:57,685 copying build/lib/lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:57,687 copying build/lib/lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:57,689 copying build/lib/lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:57,691 copying build/lib/lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:57,693 copying build/lib/lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:57,694 copying build/lib/lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:57,696 copying build/lib/lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:57,698 copying build/lib/lm_eval/tasks/turkishmmlu/config/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-02-14T10:25:57,700 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mastermind 2026-02-14T10:25:57,701 copying build/lib/lm_eval/tasks/mastermind/mastermind_35_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-02-14T10:25:57,703 copying build/lib/lm_eval/tasks/mastermind/mastermind_46_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-02-14T10:25:57,705 copying build/lib/lm_eval/tasks/mastermind/mastermind_24_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-02-14T10:25:57,706 copying build/lib/lm_eval/tasks/mastermind/mastermind_35_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-02-14T10:25:57,708 copying build/lib/lm_eval/tasks/mastermind/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-02-14T10:25:57,710 copying build/lib/lm_eval/tasks/mastermind/mastermind_46_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-02-14T10:25:57,711 copying build/lib/lm_eval/tasks/mastermind/mastermind_24_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-02-14T10:25:57,714 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/sciq 2026-02-14T10:25:57,714 copying build/lib/lm_eval/tasks/sciq/sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq 2026-02-14T10:25:57,716 copying build/lib/lm_eval/tasks/sciq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq 2026-02-14T10:25:57,719 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/winogender 2026-02-14T10:25:57,720 copying build/lib/lm_eval/tasks/winogender/winogender_male.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-02-14T10:25:57,722 copying build/lib/lm_eval/tasks/winogender/winogender_female.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-02-14T10:25:57,723 copying build/lib/lm_eval/tasks/winogender/winogender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-02-14T10:25:57,725 copying build/lib/lm_eval/tasks/winogender/winogender_neutral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-02-14T10:25:57,727 copying build/lib/lm_eval/tasks/winogender/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-02-14T10:25:57,728 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha_male.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-02-14T10:25:57,731 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha_female.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-02-14T10:25:57,733 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-02-14T10:25:57,735 copying build/lib/lm_eval/tasks/winogender/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-02-14T10:25:57,737 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue 2026-02-14T10:25:57,739 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,740 copying build/lib/lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,742 copying build/lib/lm_eval/tasks/code_x_glue/code-text/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,744 copying build/lib/lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,745 copying build/lib/lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,748 copying build/lib/lm_eval/tasks/code_x_glue/code-text/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,750 copying build/lib/lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,752 copying build/lib/lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,753 copying build/lib/lm_eval/tasks/code_x_glue/code-text/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,755 copying build/lib/lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,757 copying build/lib/lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,759 copying build/lib/lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-02-14T10:25:57,761 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc_mt 2026-02-14T10:25:57,762 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,764 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,765 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,767 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,769 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,771 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,773 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,774 copying build/lib/lm_eval/tasks/arc_mt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,776 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,778 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,780 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,781 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,783 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-02-14T10:25:57,786 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/common_voice 2026-02-14T10:25:57,787 copying build/lib/lm_eval/tasks/common_voice/common_voice_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/common_voice 2026-02-14T10:25:57,788 copying build/lib/lm_eval/tasks/common_voice/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/common_voice 2026-02-14T10:25:57,791 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wsc273 2026-02-14T10:25:57,792 copying build/lib/lm_eval/tasks/wsc273/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2026-02-14T10:25:57,794 copying build/lib/lm_eval/tasks/wsc273/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2026-02-14T10:25:57,796 copying build/lib/lm_eval/tasks/wsc273/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2026-02-14T10:25:57,798 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada 2026-02-14T10:25:57,799 copying build/lib/lm_eval/tasks/lambada/lambada_standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2026-02-14T10:25:57,801 copying build/lib/lm_eval/tasks/lambada/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2026-02-14T10:25:57,803 copying build/lib/lm_eval/tasks/lambada/lambada_openai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2026-02-14T10:25:57,805 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fda 2026-02-14T10:25:57,806 copying build/lib/lm_eval/tasks/fda/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2026-02-14T10:25:57,808 copying build/lib/lm_eval/tasks/fda/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2026-02-14T10:25:57,810 copying build/lib/lm_eval/tasks/fda/fda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2026-02-14T10:25:57,812 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_cloze 2026-02-14T10:25:57,813 copying build/lib/lm_eval/tasks/lambada_cloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2026-02-14T10:25:57,815 copying build/lib/lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2026-02-14T10:25:57,817 copying build/lib/lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2026-02-14T10:25:57,819 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aclue 2026-02-14T10:25:57,820 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,822 copying build/lib/lm_eval/tasks/aclue/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,824 copying build/lib/lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,825 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,827 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,829 copying build/lib/lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,830 copying build/lib/lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,832 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,834 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,836 copying build/lib/lm_eval/tasks/aclue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,837 copying build/lib/lm_eval/tasks/aclue/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,839 copying build/lib/lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,841 copying build/lib/lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,843 copying build/lib/lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,844 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,846 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,848 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,850 copying build/lib/lm_eval/tasks/aclue/_aclue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,852 copying build/lib/lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-02-14T10:25:57,854 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/anli 2026-02-14T10:25:57,855 copying build/lib/lm_eval/tasks/anli/anli_r1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-02-14T10:25:57,857 copying build/lib/lm_eval/tasks/anli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-02-14T10:25:57,858 copying build/lib/lm_eval/tasks/anli/anli_r2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-02-14T10:25:57,860 copying build/lib/lm_eval/tasks/anli/anli_r3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-02-14T10:25:57,862 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench 2026-02-14T10:25:57,863 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:57,865 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:57,871 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:57,873 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:57,875 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:57,877 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:57,879 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:57,880 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:57,882 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-02-14T10:25:57,885 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:57,886 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:57,888 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:57,890 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:57,892 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:57,894 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:57,896 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:57,898 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:57,900 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-02-14T10:25:57,902 copying build/lib/lm_eval/tasks/acpbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench 2026-02-14T10:25:57,905 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,906 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,908 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,910 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,912 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,915 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,917 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,920 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,922 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,925 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,927 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,930 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-02-14T10:25:57,933 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,934 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,936 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,938 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,940 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,942 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,944 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/acp_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,947 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,949 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/next_act.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,951 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,953 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,955 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-02-14T10:25:57,958 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kobest 2026-02-14T10:25:57,959 copying build/lib/lm_eval/tasks/kobest/kobest_wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-02-14T10:25:57,962 copying build/lib/lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-02-14T10:25:57,964 copying build/lib/lm_eval/tasks/kobest/_kobest.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-02-14T10:25:57,965 copying build/lib/lm_eval/tasks/kobest/kobest_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-02-14T10:25:57,967 copying build/lib/lm_eval/tasks/kobest/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-02-14T10:25:57,969 copying build/lib/lm_eval/tasks/kobest/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-02-14T10:25:57,971 copying build/lib/lm_eval/tasks/kobest/kobest_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-02-14T10:25:57,973 copying build/lib/lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-02-14T10:25:57,975 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench 2026-02-14T10:25:57,976 copying build/lib/lm_eval/tasks/basque_bench/arc_eu_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-02-14T10:25:57,978 copying build/lib/lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-02-14T10:25:57,980 copying build/lib/lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-02-14T10:25:57,981 copying build/lib/lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-02-14T10:25:57,983 copying build/lib/lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-02-14T10:25:57,985 copying build/lib/lm_eval/tasks/basque_bench/basque_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-02-14T10:25:57,987 copying build/lib/lm_eval/tasks/basque_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-02-14T10:25:57,989 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:57,990 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:57,992 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:57,994 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:57,996 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:57,998 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,000 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,002 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,004 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,006 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,008 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,010 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,012 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,013 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,015 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,017 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,018 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,020 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,022 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,024 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-02-14T10:25:58,026 copying build/lib/lm_eval/tasks/basque_bench/paws_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-02-14T10:25:58,028 copying build/lib/lm_eval/tasks/basque_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-02-14T10:25:58,029 copying build/lib/lm_eval/tasks/basque_bench/mgsm_native_cot_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-02-14T10:25:58,031 copying build/lib/lm_eval/tasks/basque_bench/arc_eu_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-02-14T10:25:58,033 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/moral_stories 2026-02-14T10:25:58,034 copying build/lib/lm_eval/tasks/moral_stories/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2026-02-14T10:25:58,037 copying build/lib/lm_eval/tasks/moral_stories/moral_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2026-02-14T10:25:58,038 copying build/lib/lm_eval/tasks/moral_stories/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2026-02-14T10:25:58,041 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/piqa 2026-02-14T10:25:58,042 copying build/lib/lm_eval/tasks/piqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa 2026-02-14T10:25:58,044 copying build/lib/lm_eval/tasks/piqa/piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa 2026-02-14T10:25:58,046 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paws-x 2026-02-14T10:25:58,047 copying build/lib/lm_eval/tasks/paws-x/paws_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,049 copying build/lib/lm_eval/tasks/paws-x/paws_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,051 copying build/lib/lm_eval/tasks/paws-x/pawsx_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,053 copying build/lib/lm_eval/tasks/paws-x/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,055 copying build/lib/lm_eval/tasks/paws-x/paws_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,056 copying build/lib/lm_eval/tasks/paws-x/paws_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,058 copying build/lib/lm_eval/tasks/paws-x/paws_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,060 copying build/lib/lm_eval/tasks/paws-x/paws_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,062 copying build/lib/lm_eval/tasks/paws-x/paws_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,063 copying build/lib/lm_eval/tasks/paws-x/_pawsx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,065 copying build/lib/lm_eval/tasks/paws-x/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,067 copying build/lib/lm_eval/tasks/paws-x/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-02-14T10:25:58,070 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bhs 2026-02-14T10:25:58,071 copying build/lib/lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,073 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,074 copying build/lib/lm_eval/tasks/bhs/hindi-S_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,076 copying build/lib/lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,078 copying build/lib/lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,079 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,081 copying build/lib/lm_eval/tasks/bhs/bhs_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,082 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,084 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,086 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,087 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,089 copying build/lib/lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,091 copying build/lib/lm_eval/tasks/bhs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,093 copying build/lib/lm_eval/tasks/bhs/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,095 copying build/lib/lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,096 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,098 copying build/lib/lm_eval/tasks/bhs/bhs_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,100 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,101 copying build/lib/lm_eval/tasks/bhs/bhs_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,103 copying build/lib/lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,105 copying build/lib/lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,107 copying build/lib/lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,108 copying build/lib/lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,110 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,112 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,114 copying build/lib/lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,116 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-02-14T10:25:58,118 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wikitext 2026-02-14T10:25:58,119 copying build/lib/lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2026-02-14T10:25:58,121 copying build/lib/lm_eval/tasks/wikitext/wikitext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2026-02-14T10:25:58,122 copying build/lib/lm_eval/tasks/wikitext/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2026-02-14T10:25:58,125 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_trivia 2026-02-14T10:25:58,126 copying build/lib/lm_eval/tasks/eus_trivia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2026-02-14T10:25:58,128 copying build/lib/lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2026-02-14T10:25:58,130 copying build/lib/lm_eval/tasks/eus_trivia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2026-02-14T10:25:58,132 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,133 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,135 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,137 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,139 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,140 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,142 copying build/lib/lm_eval/tasks/hendrycks_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,144 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,145 copying build/lib/lm_eval/tasks/hendrycks_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,148 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,150 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,151 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-02-14T10:25:58,154 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medtext 2026-02-14T10:25:58,155 copying build/lib/lm_eval/tasks/medtext/medtext_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-02-14T10:25:58,157 copying build/lib/lm_eval/tasks/medtext/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-02-14T10:25:58,159 copying build/lib/lm_eval/tasks/medtext/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-02-14T10:25:58,160 copying build/lib/lm_eval/tasks/medtext/medtext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-02-14T10:25:58,162 copying build/lib/lm_eval/tasks/medtext/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-02-14T10:25:58,165 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ceval 2026-02-14T10:25:58,166 copying build/lib/lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,168 copying build/lib/lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,170 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,172 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,174 copying build/lib/lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,175 copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,177 copying build/lib/lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,179 copying build/lib/lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,180 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,182 copying build/lib/lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,184 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,185 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,187 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,189 copying build/lib/lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,190 copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,192 copying build/lib/lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,194 copying build/lib/lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,196 copying build/lib/lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,198 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,199 copying build/lib/lm_eval/tasks/ceval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,202 copying build/lib/lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,203 copying build/lib/lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,205 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,207 copying build/lib/lm_eval/tasks/ceval/_ceval-valid.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,209 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,211 copying build/lib/lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,212 copying build/lib/lm_eval/tasks/ceval/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,215 copying build/lib/lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,217 copying build/lib/lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,219 copying build/lib/lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,220 copying build/lib/lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,222 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,224 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,225 copying build/lib/lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,227 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,229 copying build/lib/lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,231 copying build/lib/lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,232 copying build/lib/lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,234 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,236 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,238 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,239 copying build/lib/lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,241 copying build/lib/lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,243 copying build/lib/lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,245 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,247 copying build/lib/lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,248 copying build/lib/lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,250 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,252 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,254 copying build/lib/lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,256 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,257 copying build/lib/lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,259 copying build/lib/lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,261 copying build/lib/lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,263 copying build/lib/lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,265 copying build/lib/lm_eval/tasks/ceval/_default_ceval_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-02-14T10:25:58,267 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl 2026-02-14T10:25:58,269 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:58,270 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:58,272 copying build/lib/lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:58,273 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:58,275 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:58,277 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-02-14T10:25:58,278 copying build/lib/lm_eval/tasks/kbl/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl 2026-02-14T10:25:58,281 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:58,282 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:58,284 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:58,286 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:58,288 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:58,290 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:58,291 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:58,293 copying build/lib/lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:58,295 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-02-14T10:25:58,297 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam 2026-02-14T10:25:58,299 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,300 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,302 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,304 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,306 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,307 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,309 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,311 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,313 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,314 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,316 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,318 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,320 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,321 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,323 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,325 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-02-14T10:25:58,327 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,328 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,331 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,332 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,334 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,336 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,338 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,340 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,341 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,343 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,345 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,347 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,348 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,350 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,352 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,353 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-02-14T10:25:58,356 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,357 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,359 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,360 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,362 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,364 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,365 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,367 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,369 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,370 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,372 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,374 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,376 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,378 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,379 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-02-14T10:25:58,382 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,383 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,385 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,386 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,388 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,390 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,392 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,394 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,395 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,397 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,399 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,400 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,402 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,404 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,405 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-02-14T10:25:58,408 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/jsonschema_bench 2026-02-14T10:25:58,409 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-02-14T10:25:58,411 copying build/lib/lm_eval/tasks/jsonschema_bench/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-02-14T10:25:58,412 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-02-14T10:25:58,414 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-02-14T10:25:58,416 copying build/lib/lm_eval/tasks/jsonschema_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-02-14T10:25:58,419 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/babi 2026-02-14T10:25:58,420 copying build/lib/lm_eval/tasks/babi/babi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi 2026-02-14T10:25:58,422 copying build/lib/lm_eval/tasks/babi/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi 2026-02-14T10:25:58,424 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue 2026-02-14T10:25:58,426 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qqp 2026-02-14T10:25:58,427 copying build/lib/lm_eval/tasks/glue/qqp/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qqp 2026-02-14T10:25:58,429 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/rte 2026-02-14T10:25:58,430 copying build/lib/lm_eval/tasks/glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/rte 2026-02-14T10:25:58,433 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/wnli 2026-02-14T10:25:58,434 copying build/lib/lm_eval/tasks/glue/wnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/wnli 2026-02-14T10:25:58,436 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mrpc 2026-02-14T10:25:58,441 copying build/lib/lm_eval/tasks/glue/mrpc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mrpc 2026-02-14T10:25:58,443 copying build/lib/lm_eval/tasks/glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue 2026-02-14T10:25:58,445 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qnli 2026-02-14T10:25:58,446 copying build/lib/lm_eval/tasks/glue/qnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qnli 2026-02-14T10:25:58,449 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/cola 2026-02-14T10:25:58,450 copying build/lib/lm_eval/tasks/glue/cola/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/cola 2026-02-14T10:25:58,452 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mnli 2026-02-14T10:25:58,453 copying build/lib/lm_eval/tasks/glue/mnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2026-02-14T10:25:58,455 copying build/lib/lm_eval/tasks/glue/mnli/mismatch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2026-02-14T10:25:58,456 copying build/lib/lm_eval/tasks/glue/mnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2026-02-14T10:25:58,459 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/sst2 2026-02-14T10:25:58,460 copying build/lib/lm_eval/tasks/glue/sst2/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/sst2 2026-02-14T10:25:58,462 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/longbench2 2026-02-14T10:25:58,463 copying build/lib/lm_eval/tasks/longbench2/event_order.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,465 copying build/lib/lm_eval/tasks/longbench2/news_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,467 copying build/lib/lm_eval/tasks/longbench2/fin_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,469 copying build/lib/lm_eval/tasks/longbench2/table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,471 copying build/lib/lm_eval/tasks/longbench2/detective.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,472 copying build/lib/lm_eval/tasks/longbench2/user_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,474 copying build/lib/lm_eval/tasks/longbench2/_longbench2_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,476 copying build/lib/lm_eval/tasks/longbench2/legal_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,477 copying build/lib/lm_eval/tasks/longbench2/_longbench2_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,479 copying build/lib/lm_eval/tasks/longbench2/_longbench2_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,481 copying build/lib/lm_eval/tasks/longbench2/govt_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,483 copying build/lib/lm_eval/tasks/longbench2/govt_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,484 copying build/lib/lm_eval/tasks/longbench2/_longbench2_structured.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,486 copying build/lib/lm_eval/tasks/longbench2/many_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,488 copying build/lib/lm_eval/tasks/longbench2/translate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,490 copying build/lib/lm_eval/tasks/longbench2/_longbench2_incontext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,492 copying build/lib/lm_eval/tasks/longbench2/lit_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,494 copying build/lib/lm_eval/tasks/longbench2/_longbench2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,496 copying build/lib/lm_eval/tasks/longbench2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,498 copying build/lib/lm_eval/tasks/longbench2/legal_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,500 copying build/lib/lm_eval/tasks/longbench2/academic_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,501 copying build/lib/lm_eval/tasks/longbench2/agent_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,503 copying build/lib/lm_eval/tasks/longbench2/dialogue_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,505 copying build/lib/lm_eval/tasks/longbench2/fin_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,507 copying build/lib/lm_eval/tasks/longbench2/graph.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,508 copying build/lib/lm_eval/tasks/longbench2/longbench2_code.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,510 copying build/lib/lm_eval/tasks/longbench2/_longbench_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,512 copying build/lib/lm_eval/tasks/longbench2/academic_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-02-14T10:25:58,514 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:58,515 copying build/lib/lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:58,517 copying build/lib/lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:58,519 copying build/lib/lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:58,521 copying build/lib/lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:58,522 copying build/lib/lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:58,524 copying build/lib/lm_eval/tasks/humaneval_infilling/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:58,526 copying build/lib/lm_eval/tasks/humaneval_infilling/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-02-14T10:25:58,528 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qa4mre 2026-02-14T10:25:58,529 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-02-14T10:25:58,531 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-02-14T10:25:58,533 copying build/lib/lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-02-14T10:25:58,535 copying build/lib/lm_eval/tasks/qa4mre/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-02-14T10:25:58,537 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-02-14T10:25:58,540 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/webqs 2026-02-14T10:25:58,541 copying build/lib/lm_eval/tasks/webqs/webqs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2026-02-14T10:25:58,543 copying build/lib/lm_eval/tasks/webqs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2026-02-14T10:25:58,545 copying build/lib/lm_eval/tasks/webqs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2026-02-14T10:25:58,547 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa 2026-02-14T10:25:58,549 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/copa_ar 2026-02-14T10:25:58,550 copying build/lib/lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar 2026-02-14T10:25:58,552 copying build/lib/lm_eval/tasks/alghafa/copa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar 2026-02-14T10:25:58,554 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/piqa_ar 2026-02-14T10:25:58,555 copying build/lib/lm_eval/tasks/alghafa/piqa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar 2026-02-14T10:25:58,557 copying build/lib/lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar 2026-02-14T10:25:58,559 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/meqsum 2026-02-14T10:25:58,560 copying build/lib/lm_eval/tasks/meqsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2026-02-14T10:25:58,562 copying build/lib/lm_eval/tasks/meqsum/meqsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2026-02-14T10:25:58,564 copying build/lib/lm_eval/tasks/meqsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2026-02-14T10:25:58,566 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr 2026-02-14T10:25:58,568 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,569 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,571 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,573 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,575 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,577 copying build/lib/lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,578 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,580 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,582 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,583 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,585 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,587 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,589 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,590 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,592 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,594 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,596 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,598 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,599 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,601 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,603 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,604 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,606 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,608 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,610 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,612 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,613 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,615 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,617 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,619 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,621 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,622 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,624 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,626 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,628 copying build/lib/lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,629 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,631 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,633 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,635 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,637 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,639 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,641 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,642 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,644 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,646 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,648 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,649 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,651 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,653 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,655 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,657 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,658 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,660 copying build/lib/lm_eval/tasks/mmlusr/question_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,662 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,664 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,666 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,668 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,670 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,672 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,673 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,675 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-02-14T10:25:58,678 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,679 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,681 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,683 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,685 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,686 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,688 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,690 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,691 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,693 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,695 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,696 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,698 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,700 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,701 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,703 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,706 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,708 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,709 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,711 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,713 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,715 copying build/lib/lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,717 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,718 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,720 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,722 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,723 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,725 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,727 copying build/lib/lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,729 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,731 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,732 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,734 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,736 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,738 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,739 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,741 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,743 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,746 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,748 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,749 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,751 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,753 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,755 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,757 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,758 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,760 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,762 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,763 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,765 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,767 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,769 copying build/lib/lm_eval/tasks/mmlusr/answer_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,770 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,772 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,774 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,776 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,777 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,779 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,781 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,783 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,784 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-02-14T10:25:58,786 copying build/lib/lm_eval/tasks/mmlusr/config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr 2026-02-14T10:25:58,788 copying build/lib/lm_eval/tasks/mmlusr/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr 2026-02-14T10:25:58,791 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,792 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,794 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,796 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,798 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,800 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,801 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,803 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,805 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,806 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,808 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,809 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,811 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,813 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,815 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,817 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,819 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,820 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,822 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,824 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,826 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,827 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,829 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,831 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,833 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,834 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,836 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,838 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,839 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,841 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,843 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,844 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,846 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,848 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,850 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,852 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,853 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,855 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,857 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,859 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,861 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,863 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,864 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,866 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,868 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,869 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,871 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,873 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,874 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,876 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,878 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,880 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,881 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,883 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,885 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,887 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,888 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,890 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,892 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,894 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,895 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-02-14T10:25:58,898 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glianorex 2026-02-14T10:25:58,899 copying build/lib/lm_eval/tasks/glianorex/glianorex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-02-14T10:25:58,901 copying build/lib/lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-02-14T10:25:58,903 copying build/lib/lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-02-14T10:25:58,905 copying build/lib/lm_eval/tasks/glianorex/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-02-14T10:25:58,907 copying build/lib/lm_eval/tasks/glianorex/glianorex_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-02-14T10:25:58,909 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hellaswag 2026-02-14T10:25:58,910 copying build/lib/lm_eval/tasks/hellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2026-02-14T10:25:58,912 copying build/lib/lm_eval/tasks/hellaswag/hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2026-02-14T10:25:58,914 copying build/lib/lm_eval/tasks/hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2026-02-14T10:25:58,916 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm8k 2026-02-14T10:25:58,917 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-02-14T10:25:58,919 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-02-14T10:25:58,921 copying build/lib/lm_eval/tasks/gsm8k/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-02-14T10:25:58,922 copying build/lib/lm_eval/tasks/gsm8k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-02-14T10:25:58,924 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-02-14T10:25:58,926 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-02-14T10:25:58,928 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swag 2026-02-14T10:25:58,929 copying build/lib/lm_eval/tasks/swag/swag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag 2026-02-14T10:25:58,931 copying build/lib/lm_eval/tasks/swag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag 2026-02-14T10:25:58,933 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,935 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/phrases_es 2026-02-14T10:25:58,936 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2026-02-14T10:25:58,938 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2026-02-14T10:25:58,940 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2026-02-14T10:25:58,942 copying build/lib/lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,943 copying build/lib/lm_eval/tasks/spanish_bench/cocoteros_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,945 copying build/lib/lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,947 copying build/lib/lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,949 copying build/lib/lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,950 copying build/lib/lm_eval/tasks/spanish_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,953 copying build/lib/lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,954 copying build/lib/lm_eval/tasks/spanish_bench/escola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,956 copying build/lib/lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,958 copying build/lib/lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,960 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,961 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,963 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,965 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,967 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,968 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,970 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,972 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,974 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,975 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,977 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,979 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,981 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,982 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,984 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,986 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,988 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,990 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,992 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,994 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-02-14T10:25:58,996 copying build/lib/lm_eval/tasks/spanish_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:58,997 copying build/lib/lm_eval/tasks/spanish_bench/copa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-02-14T10:25:59,000 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/egymmlu 2026-02-14T10:25:59,002 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,004 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,006 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,008 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,009 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,011 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,013 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,014 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,016 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,018 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,019 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,021 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,023 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,024 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,026 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,028 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,030 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,031 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,033 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,035 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,037 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,038 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,040 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,042 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,043 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,045 copying build/lib/lm_eval/tasks/egymmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,047 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_political_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,049 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,050 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,052 copying build/lib/lm_eval/tasks/egymmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,054 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,056 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,058 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,059 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,061 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,063 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,064 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,067 copying build/lib/lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,069 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,071 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,073 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,075 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,077 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,080 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,082 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,084 copying build/lib/lm_eval/tasks/egymmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,086 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,087 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,089 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,091 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,093 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-02-14T10:25:59,095 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mediqa_qa2019 2026-02-14T10:25:59,096 copying build/lib/lm_eval/tasks/mediqa_qa2019/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-02-14T10:25:59,098 copying build/lib/lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-02-14T10:25:59,100 copying build/lib/lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-02-14T10:25:59,101 copying build/lib/lm_eval/tasks/mediqa_qa2019/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-02-14T10:25:59,103 copying build/lib/lm_eval/tasks/mediqa_qa2019/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-02-14T10:25:59,106 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/headqa 2026-02-14T10:25:59,107 copying build/lib/lm_eval/tasks/headqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2026-02-14T10:25:59,109 copying build/lib/lm_eval/tasks/headqa/headqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2026-02-14T10:25:59,110 copying build/lib/lm_eval/tasks/headqa/headqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2026-02-14T10:25:59,112 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu 2026-02-14T10:25:59,115 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,116 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,118 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,119 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,121 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,122 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,124 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,126 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,128 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,130 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,131 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,133 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,135 copying build/lib/lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,137 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,139 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,141 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,143 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,145 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,147 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,149 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,151 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,152 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,155 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,156 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,158 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,160 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,162 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,163 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,165 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,167 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,169 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,170 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,172 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,174 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,175 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,177 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,179 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,181 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,183 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,184 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,186 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,188 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,190 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,192 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,194 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,196 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,198 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,199 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,201 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,203 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,205 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,207 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-02-14T10:25:59,210 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,211 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,213 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,215 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,217 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,218 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,220 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,222 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,223 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,225 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,227 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,229 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,230 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,232 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,234 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,236 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,238 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,239 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,241 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,243 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,245 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,246 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,248 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,250 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,251 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,253 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,255 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,256 copying build/lib/lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,258 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,260 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,261 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,263 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,265 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,267 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,268 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,270 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,272 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,273 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,275 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,277 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,279 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,280 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,282 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,284 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,286 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,288 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,289 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,291 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,293 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,295 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,297 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,298 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-02-14T10:25:59,300 copying build/lib/lm_eval/tasks/kmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu 2026-02-14T10:25:59,304 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,305 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,306 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,308 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,310 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,311 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,313 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,315 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,317 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,319 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,320 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,322 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,324 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,326 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,327 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,329 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,331 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,332 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,334 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,335 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,337 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,339 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,341 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,342 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,344 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,346 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,348 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,349 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,351 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,353 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,355 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,357 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,358 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,360 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,362 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,364 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,365 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,367 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,369 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,371 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,372 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,374 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,376 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,377 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,379 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,381 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,382 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,384 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,386 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,388 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,389 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,391 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-02-14T10:25:59,394 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,395 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,398 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,400 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,402 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,405 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,407 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,410 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,412 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,414 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,416 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,418 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,420 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,423 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,425 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,427 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,429 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,431 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,433 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,435 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,437 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,439 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,441 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,444 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,446 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,448 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,450 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,452 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,454 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,457 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,459 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,461 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,463 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,465 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,468 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,470 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,471 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,474 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,476 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,479 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,481 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,483 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,485 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,488 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,490 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,492 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,495 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,497 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,500 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,502 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,504 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,506 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-02-14T10:25:59,510 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,511 copying build/lib/lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,513 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,514 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,516 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,518 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,519 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,521 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,523 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,524 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,526 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,527 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,529 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,531 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,532 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,534 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,536 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,538 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,540 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,541 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,543 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,545 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,546 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,548 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,550 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,552 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,553 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,555 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,557 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,559 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,560 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,562 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,563 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,565 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,567 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,568 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,570 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,571 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,573 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,575 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,577 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,578 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,580 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,582 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,584 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,585 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,587 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,589 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,591 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,592 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,594 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,596 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-02-14T10:25:59,598 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openbookqa 2026-02-14T10:25:59,599 copying build/lib/lm_eval/tasks/openbookqa/openbookqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa 2026-02-14T10:25:59,601 copying build/lib/lm_eval/tasks/openbookqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa 2026-02-14T10:25:59,603 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xquad 2026-02-14T10:25:59,604 copying build/lib/lm_eval/tasks/xquad/xquad_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,606 copying build/lib/lm_eval/tasks/xquad/xquad_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,608 copying build/lib/lm_eval/tasks/xquad/xquad_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,609 copying build/lib/lm_eval/tasks/xquad/xquad_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,611 copying build/lib/lm_eval/tasks/xquad/xquad_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,612 copying build/lib/lm_eval/tasks/xquad/xquad_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,614 copying build/lib/lm_eval/tasks/xquad/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,616 copying build/lib/lm_eval/tasks/xquad/xquad_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,617 copying build/lib/lm_eval/tasks/xquad/xquad_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,619 copying build/lib/lm_eval/tasks/xquad/xquad_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,621 copying build/lib/lm_eval/tasks/xquad/xquad_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,622 copying build/lib/lm_eval/tasks/xquad/xquad_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,624 copying build/lib/lm_eval/tasks/xquad/xquad_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,626 copying build/lib/lm_eval/tasks/xquad/xquad_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,627 copying build/lib/lm_eval/tasks/xquad/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-02-14T10:25:59,631 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,632 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_OSV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,634 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,636 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,638 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,639 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,641 copying build/lib/lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,643 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_d.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,644 copying build/lib/lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,646 copying build/lib/lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,648 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,650 copying build/lib/lm_eval/tasks/zhoblimp/BEI_preposition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,651 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,653 copying build/lib/lm_eval/tasks/zhoblimp/preposition_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,655 copying build/lib/lm_eval/tasks/zhoblimp/relative_operator_who.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,656 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,658 copying build/lib/lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,659 copying build/lib/lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,661 copying build/lib/lm_eval/tasks/zhoblimp/causative_shi_ba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,663 copying build/lib/lm_eval/tasks/zhoblimp/zhoblimp_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,665 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,666 copying build/lib/lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,668 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,670 copying build/lib/lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,671 copying build/lib/lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,673 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,675 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_domain.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,677 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,678 copying build/lib/lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,680 copying build/lib/lm_eval/tasks/zhoblimp/passive_body_part.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,682 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,683 copying build/lib/lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,685 copying build/lib/lm_eval/tasks/zhoblimp/agent_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,687 copying build/lib/lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,688 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,690 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,692 copying build/lib/lm_eval/tasks/zhoblimp/BA_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,693 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,695 copying build/lib/lm_eval/tasks/zhoblimp/verb_negation_particle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,697 copying build/lib/lm_eval/tasks/zhoblimp/nominal_definite_men.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,699 copying build/lib/lm_eval/tasks/zhoblimp/PN_numP_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,700 copying build/lib/lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,702 copying build/lib/lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,703 copying build/lib/lm_eval/tasks/zhoblimp/BEI_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,705 copying build/lib/lm_eval/tasks/zhoblimp/passive_intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,707 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,708 copying build/lib/lm_eval/tasks/zhoblimp/BA_meiba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,710 copying build/lib/lm_eval/tasks/zhoblimp/ya_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,712 copying build/lib/lm_eval/tasks/zhoblimp/BEI_construction_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,713 copying build/lib/lm_eval/tasks/zhoblimp/passive_suo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,715 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,717 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,718 copying build/lib/lm_eval/tasks/zhoblimp/BA_no_progressive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,720 copying build/lib/lm_eval/tasks/zhoblimp/BEI_construction_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,722 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,723 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,725 copying build/lib/lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,726 copying build/lib/lm_eval/tasks/zhoblimp/right_yijing_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,728 copying build/lib/lm_eval/tasks/zhoblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,730 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,732 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,733 copying build/lib/lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,735 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,737 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,738 copying build/lib/lm_eval/tasks/zhoblimp/modal_raising_hui.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,740 copying build/lib/lm_eval/tasks/zhoblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,742 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,744 copying build/lib/lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,745 copying build/lib/lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,747 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,748 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,750 copying build/lib/lm_eval/tasks/zhoblimp/agent_causative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,752 copying build/lib/lm_eval/tasks/zhoblimp/BA_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,753 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,755 copying build/lib/lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,757 copying build/lib/lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,758 copying build/lib/lm_eval/tasks/zhoblimp/PN_numP_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,760 copying build/lib/lm_eval/tasks/zhoblimp/preposition_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,762 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,763 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,765 copying build/lib/lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,767 copying build/lib/lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,768 copying build/lib/lm_eval/tasks/zhoblimp/passive_no_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,770 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,772 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,773 copying build/lib/lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,775 copying build/lib/lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,777 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,778 copying build/lib/lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,780 copying build/lib/lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,782 copying build/lib/lm_eval/tasks/zhoblimp/left_dou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,784 copying build/lib/lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,786 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,787 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,789 copying build/lib/lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,791 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_nandao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,792 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,794 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,796 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,797 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,799 copying build/lib/lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,800 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,802 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_SOV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,804 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,805 copying build/lib/lm_eval/tasks/zhoblimp/right_yijing_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,807 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,809 copying build/lib/lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,810 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,812 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,814 copying build/lib/lm_eval/tasks/zhoblimp/you_yige.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,815 copying build/lib/lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,817 copying build/lib/lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,819 copying build/lib/lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,820 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,822 copying build/lib/lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,824 copying build/lib/lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,826 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,827 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,829 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,831 copying build/lib/lm_eval/tasks/zhoblimp/BA_inversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,833 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,834 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-02-14T10:25:59,837 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swde 2026-02-14T10:25:59,838 copying build/lib/lm_eval/tasks/swde/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2026-02-14T10:25:59,839 copying build/lib/lm_eval/tasks/swde/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2026-02-14T10:25:59,841 copying build/lib/lm_eval/tasks/swde/swde.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2026-02-14T10:25:59,844 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mts_dialog 2026-02-14T10:25:59,845 copying build/lib/lm_eval/tasks/mts_dialog/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-02-14T10:25:59,847 copying build/lib/lm_eval/tasks/mts_dialog/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-02-14T10:25:59,848 copying build/lib/lm_eval/tasks/mts_dialog/mts_dialog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-02-14T10:25:59,850 copying build/lib/lm_eval/tasks/mts_dialog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-02-14T10:25:59,852 copying build/lib/lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-02-14T10:25:59,854 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm_plus 2026-02-14T10:25:59,855 copying build/lib/lm_eval/tasks/gsm_plus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2026-02-14T10:25:59,857 copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2026-02-14T10:25:59,859 copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2026-02-14T10:25:59,861 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ulqa 2026-02-14T10:25:59,862 copying build/lib/lm_eval/tasks/ulqa/celep2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-02-14T10:25:59,864 copying build/lib/lm_eval/tasks/ulqa/lambada_uyghur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-02-14T10:25:59,866 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:59,867 copying build/lib/lm_eval/tasks/ulqa/ulut/ulut.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:59,869 copying build/lib/lm_eval/tasks/ulqa/ulut/wub.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:59,871 copying build/lib/lm_eval/tasks/ulqa/ulut/nug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:59,873 copying build/lib/lm_eval/tasks/ulqa/ulut/wag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:59,874 copying build/lib/lm_eval/tasks/ulqa/ulut/wum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:59,876 copying build/lib/lm_eval/tasks/ulqa/ulut/wsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-02-14T10:25:59,878 copying build/lib/lm_eval/tasks/ulqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-02-14T10:25:59,879 copying build/lib/lm_eval/tasks/ulqa/celep1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-02-14T10:25:59,881 copying build/lib/lm_eval/tasks/ulqa/ulqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-02-14T10:25:59,883 copying build/lib/lm_eval/tasks/ulqa/uleval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-02-14T10:25:59,885 copying build/lib/lm_eval/tasks/ulqa/ulqa_.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-02-14T10:25:59,887 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli_eu 2026-02-14T10:25:59,888 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-02-14T10:25:59,890 copying build/lib/lm_eval/tasks/xnli_eu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-02-14T10:25:59,892 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-02-14T10:25:59,893 copying build/lib/lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-02-14T10:25:59,895 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-02-14T10:25:59,897 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/translation 2026-02-14T10:25:59,898 copying build/lib/lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-02-14T10:25:59,900 copying build/lib/lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-02-14T10:25:59,901 copying build/lib/lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-02-14T10:25:59,903 copying build/lib/lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-02-14T10:25:59,905 copying build/lib/lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-02-14T10:25:59,906 copying build/lib/lm_eval/tasks/translation/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-02-14T10:25:59,908 copying build/lib/lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-02-14T10:25:59,910 copying build/lib/lm_eval/tasks/translation/wmt16_en-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-02-14T10:25:59,911 copying build/lib/lm_eval/tasks/translation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-02-14T10:25:59,913 copying build/lib/lm_eval/tasks/translation/wmt16_de-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-02-14T10:25:59,915 copying build/lib/lm_eval/tasks/translation/wmt_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-02-14T10:25:59,917 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light 2026-02-14T10:25:59,919 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-02-14T10:25:59,920 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-02-14T10:25:59,922 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-02-14T10:25:59,924 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-02-14T10:25:59,926 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-02-14T10:25:59,927 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-02-14T10:25:59,929 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-02-14T10:25:59,931 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-02-14T10:25:59,934 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,935 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,937 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,938 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,940 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,942 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,944 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,946 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,947 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,949 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,951 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,952 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,954 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,956 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,958 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,959 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,961 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,963 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,965 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,966 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,968 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,970 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,972 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,974 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,975 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,977 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,979 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,981 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,982 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,984 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,986 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,987 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,989 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,991 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,992 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,994 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,996 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,998 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:25:59,999 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,001 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,003 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,005 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,007 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,008 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,010 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,011 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,013 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,015 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,017 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,018 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,020 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,022 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,024 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,026 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,028 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,029 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,031 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,033 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,035 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,037 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-02-14T10:26:00,039 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-02-14T10:26:00,040 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-02-14T10:26:00,042 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-02-14T10:26:00,043 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-02-14T10:26:00,046 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-02-14T10:26:00,047 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-02-14T10:26:00,049 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-02-14T10:26:00,051 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-02-14T10:26:00,053 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-02-14T10:26:00,054 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-02-14T10:26:00,056 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-02-14T10:26:00,058 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-02-14T10:26:00,059 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light 2026-02-14T10:26:00,062 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,063 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,065 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,067 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,068 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,070 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,072 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,074 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,075 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,077 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,079 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,081 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-02-14T10:26:00,083 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light 2026-02-14T10:26:00,086 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-02-14T10:26:00,087 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-02-14T10:26:00,089 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-02-14T10:26:00,091 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-02-14T10:26:00,093 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-02-14T10:26:00,094 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-02-14T10:26:00,096 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-02-14T10:26:00,097 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-02-14T10:26:00,100 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-02-14T10:26:00,101 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-02-14T10:26:00,103 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-02-14T10:26:00,105 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-02-14T10:26:00,107 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-02-14T10:26:00,108 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-02-14T10:26:00,110 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-02-14T10:26:00,112 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-02-14T10:26:00,116 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,117 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,119 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,121 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,123 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,125 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,127 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,129 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,131 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,133 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,134 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,137 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,139 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,141 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,143 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,145 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,147 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,149 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,151 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,153 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,154 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,156 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,158 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,159 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,161 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,163 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,165 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,167 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,169 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,170 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,172 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,174 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,176 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,178 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,179 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,181 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,183 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,185 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,187 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,188 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,190 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,192 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,193 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,195 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,197 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,199 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,200 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,202 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,204 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,206 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,208 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,209 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,211 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,213 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,215 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,216 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,218 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,220 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,222 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,224 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,225 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-02-14T10:26:00,228 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-02-14T10:26:00,229 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-02-14T10:26:00,230 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-02-14T10:26:00,232 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-02-14T10:26:00,234 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-02-14T10:26:00,236 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-02-14T10:26:00,238 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-02-14T10:26:00,239 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-02-14T10:26:00,241 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-02-14T10:26:00,242 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-02-14T10:26:00,244 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-02-14T10:26:00,246 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-02-14T10:26:00,248 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/race 2026-02-14T10:26:00,249 copying build/lib/lm_eval/tasks/race/race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2026-02-14T10:26:00,251 copying build/lib/lm_eval/tasks/race/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2026-02-14T10:26:00,253 copying build/lib/lm_eval/tasks/race/preprocess_race.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2026-02-14T10:26:00,255 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh 2026-02-14T10:26:00,257 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,258 copying build/lib/lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,260 copying build/lib/lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,262 copying build/lib/lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,264 copying build/lib/lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,266 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,268 copying build/lib/lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,269 copying build/lib/lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,271 copying build/lib/lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,273 copying build/lib/lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,275 copying build/lib/lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,277 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,279 copying build/lib/lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,281 copying build/lib/lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,282 copying build/lib/lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,284 copying build/lib/lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,286 copying build/lib/lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,287 copying build/lib/lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,289 copying build/lib/lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,291 copying build/lib/lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,292 copying build/lib/lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,294 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,296 copying build/lib/lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,298 copying build/lib/lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,299 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,301 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,303 copying build/lib/lm_eval/tasks/bbh/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,305 copying build/lib/lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,307 copying build/lib/lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,309 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,311 copying build/lib/lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-02-14T10:26:00,312 copying build/lib/lm_eval/tasks/bbh/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh 2026-02-14T10:26:00,315 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,316 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,318 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,320 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,322 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,323 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,325 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,327 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,329 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,330 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,332 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,334 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,335 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,337 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,339 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,341 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,343 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,344 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,347 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,348 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,350 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,352 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,353 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,355 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,357 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,359 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,360 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,363 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,365 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,367 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,369 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-02-14T10:26:00,372 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,373 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,375 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,377 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,379 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,381 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,383 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,386 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,388 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,390 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,392 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,394 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,396 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,398 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,400 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,402 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,404 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,406 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,408 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,410 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,412 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,414 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,416 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,418 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,420 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,422 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,423 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,425 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,427 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,429 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,430 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-02-14T10:26:00,433 copying build/lib/lm_eval/tasks/bbh/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh 2026-02-14T10:26:00,436 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,436 copying build/lib/lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,438 copying build/lib/lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,440 copying build/lib/lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,442 copying build/lib/lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,444 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,445 copying build/lib/lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,447 copying build/lib/lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,449 copying build/lib/lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,451 copying build/lib/lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,453 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,455 copying build/lib/lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,456 copying build/lib/lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,458 copying build/lib/lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,460 copying build/lib/lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,462 copying build/lib/lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,463 copying build/lib/lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,466 copying build/lib/lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,467 copying build/lib/lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,469 copying build/lib/lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,471 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,473 copying build/lib/lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,475 copying build/lib/lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,477 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,479 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,481 copying build/lib/lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,483 copying build/lib/lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,484 copying build/lib/lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,486 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,488 copying build/lib/lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-02-14T10:26:00,491 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard 2026-02-14T10:26:00,493 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,494 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,496 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,498 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,500 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,502 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,504 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,506 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,508 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,510 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,512 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,514 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,516 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,518 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,519 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,521 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,523 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,525 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,527 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,529 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,531 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,532 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,534 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,536 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,538 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,539 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,541 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-02-14T10:26:00,544 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/mmlu_pro 2026-02-14T10:26:00,545 copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro 2026-02-14T10:26:00,547 copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro 2026-02-14T10:26:00,549 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:26:00,550 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:26:00,552 copying build/lib/lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:26:00,554 copying build/lib/lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:26:00,556 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:26:00,557 copying build/lib/lm_eval/tasks/leaderboard/gpqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:26:00,559 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-02-14T10:26:00,561 copying build/lib/lm_eval/tasks/leaderboard/leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard 2026-02-14T10:26:00,563 copying build/lib/lm_eval/tasks/leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard 2026-02-14T10:26:00,566 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/math 2026-02-14T10:26:00,567 copying build/lib/lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-02-14T10:26:00,569 copying build/lib/lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-02-14T10:26:00,570 copying build/lib/lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-02-14T10:26:00,572 copying build/lib/lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-02-14T10:26:00,574 copying build/lib/lm_eval/tasks/leaderboard/math/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-02-14T10:26:00,575 copying build/lib/lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-02-14T10:26:00,577 copying build/lib/lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-02-14T10:26:00,578 copying build/lib/lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-02-14T10:26:00,580 copying build/lib/lm_eval/tasks/leaderboard/math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-02-14T10:26:00,582 copying build/lib/lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-02-14T10:26:00,585 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:26:00,586 copying build/lib/lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:26:00,588 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:26:00,591 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:26:00,594 copying build/lib/lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:26:00,596 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:26:00,598 copying build/lib/lm_eval/tasks/leaderboard/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-02-14T10:26:00,601 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/musr 2026-02-14T10:26:00,602 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-02-14T10:26:00,605 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-02-14T10:26:00,606 copying build/lib/lm_eval/tasks/leaderboard/musr/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-02-14T10:26:00,608 copying build/lib/lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-02-14T10:26:00,610 copying build/lib/lm_eval/tasks/leaderboard/musr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-02-14T10:26:00,612 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-02-14T10:26:00,615 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mutual 2026-02-14T10:26:00,616 copying build/lib/lm_eval/tasks/mutual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-02-14T10:26:00,617 copying build/lib/lm_eval/tasks/mutual/multual_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-02-14T10:26:00,619 copying build/lib/lm_eval/tasks/mutual/mutual.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-02-14T10:26:00,621 copying build/lib/lm_eval/tasks/mutual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-02-14T10:26:00,623 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc 2026-02-14T10:26:00,625 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,626 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,628 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,630 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,632 copying build/lib/lm_eval/tasks/e2lmc/noor/_noor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,634 copying build/lib/lm_eval/tasks/e2lmc/noor/_noor_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,636 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,638 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,639 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,641 copying build/lib/lm_eval/tasks/e2lmc/noor/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,643 copying build/lib/lm_eval/tasks/e2lmc/noor/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,645 copying build/lib/lm_eval/tasks/e2lmc/noor/_noor_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,647 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,649 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,651 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,653 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,655 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,656 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-02-14T10:26:00,659 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:26:00,660 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:26:00,662 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/_var5shots_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:26:00,664 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:26:00,665 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:26:00,667 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:26:00,669 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/_sciknoweval_mcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:26:00,671 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Material.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-02-14T10:26:00,673 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc/mmlu_early_training 2026-02-14T10:26:00,674 copying build/lib/lm_eval/tasks/e2lmc/mmlu_early_training/custom_metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/mmlu_early_training 2026-02-14T10:26:00,676 copying build/lib/lm_eval/tasks/e2lmc/mmlu_early_training/mmlu_early_training.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/mmlu_early_training 2026-02-14T10:26:00,678 copying build/lib/lm_eval/tasks/e2lmc/mmlu_early_training/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/mmlu_early_training 2026-02-14T10:26:00,681 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eq_bench 2026-02-14T10:26:00,682 copying build/lib/lm_eval/tasks/eq_bench/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2026-02-14T10:26:00,684 copying build/lib/lm_eval/tasks/eq_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2026-02-14T10:26:00,686 copying build/lib/lm_eval/tasks/eq_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2026-02-14T10:26:00,688 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eq_bench/multilingual 2026-02-14T10:26:00,689 copying build/lib/lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2026-02-14T10:26:00,691 copying build/lib/lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2026-02-14T10:26:00,693 copying build/lib/lm_eval/tasks/eq_bench/multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2026-02-14T10:26:00,695 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/haerae 2026-02-14T10:26:00,696 copying build/lib/lm_eval/tasks/haerae/haerae_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-02-14T10:26:00,698 copying build/lib/lm_eval/tasks/haerae/haerae_lw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-02-14T10:26:00,700 copying build/lib/lm_eval/tasks/haerae/haerae_gk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-02-14T10:26:00,702 copying build/lib/lm_eval/tasks/haerae/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-02-14T10:26:00,704 copying build/lib/lm_eval/tasks/haerae/_haerae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-02-14T10:26:00,706 copying build/lib/lm_eval/tasks/haerae/haerae_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-02-14T10:26:00,707 copying build/lib/lm_eval/tasks/haerae/haerae_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-02-14T10:26:00,709 copying build/lib/lm_eval/tasks/haerae/_default_haerae_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-02-14T10:26:00,712 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,713 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,715 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,717 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,719 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,721 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,722 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,724 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,725 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,727 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,729 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,730 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,732 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,734 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,736 copying build/lib/lm_eval/tasks/crows_pairs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,738 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,740 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,742 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,743 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,745 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,747 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,749 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,751 copying build/lib/lm_eval/tasks/crows_pairs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,753 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,754 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-02-14T10:26:00,757 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_proficiency 2026-02-14T10:26:00,758 copying build/lib/lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency 2026-02-14T10:26:00,760 copying build/lib/lm_eval/tasks/eus_proficiency/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency 2026-02-14T10:26:00,762 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qasper 2026-02-14T10:26:00,763 copying build/lib/lm_eval/tasks/qasper/bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-02-14T10:26:00,765 copying build/lib/lm_eval/tasks/qasper/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-02-14T10:26:00,767 copying build/lib/lm_eval/tasks/qasper/freeform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-02-14T10:26:00,769 copying build/lib/lm_eval/tasks/qasper/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-02-14T10:26:00,770 copying build/lib/lm_eval/tasks/qasper/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-02-14T10:26:00,774 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,775 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,777 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,779 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,781 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,783 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,784 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,786 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,788 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,790 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,792 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,794 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,796 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,798 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,800 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,802 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,803 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,805 copying build/lib/lm_eval/tasks/evalita_llm/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,808 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,809 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,811 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,813 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,815 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,817 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,818 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,820 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,822 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,823 copying build/lib/lm_eval/tasks/evalita_llm/_re_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,825 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,827 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,829 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,831 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,832 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,834 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,836 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,838 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,840 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,842 copying build/lib/lm_eval/tasks/evalita_llm/_faq_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,843 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,845 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,847 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,849 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,851 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,852 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,854 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,856 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,858 copying build/lib/lm_eval/tasks/evalita_llm/_hs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,860 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,862 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,863 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,865 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,867 copying build/lib/lm_eval/tasks/evalita_llm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,869 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,870 copying build/lib/lm_eval/tasks/evalita_llm/_sa_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,872 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,874 copying build/lib/lm_eval/tasks/evalita_llm/sum_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,875 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,877 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,879 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,881 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,882 copying build/lib/lm_eval/tasks/evalita_llm/_at_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,884 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,886 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,888 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,889 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,891 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,893 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,894 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,896 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,898 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,900 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,902 copying build/lib/lm_eval/tasks/evalita_llm/_sa_template_v2_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,903 copying build/lib/lm_eval/tasks/evalita_llm/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,905 copying build/lib/lm_eval/tasks/evalita_llm/_ner_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,907 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,910 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,912 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,914 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,916 copying build/lib/lm_eval/tasks/evalita_llm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,919 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,921 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_fp_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,924 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,926 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,928 copying build/lib/lm_eval/tasks/evalita_llm/_wic_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,930 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,932 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,934 copying build/lib/lm_eval/tasks/evalita_llm/_ls_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,936 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,938 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,940 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,943 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,945 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,947 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,949 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-02-14T10:26:00,952 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score 2026-02-14T10:26:00,954 copying build/lib/lm_eval/tasks/score/score_robustness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-02-14T10:26:00,957 copying build/lib/lm_eval/tasks/score/NON_GREEDY.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-02-14T10:26:00,960 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,961 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,964 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,966 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,968 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,970 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,972 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,975 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,977 copying build/lib/lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,979 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,981 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,983 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,986 copying build/lib/lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,988 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,990 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,992 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,994 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,997 copying build/lib/lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:00,999 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:01,001 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:01,003 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:01,006 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:01,008 copying build/lib/lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:01,011 copying build/lib/lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:01,012 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:01,014 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:01,016 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:01,018 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-02-14T10:26:01,020 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/mmlu_pro 2026-02-14T10:26:01,021 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-02-14T10:26:01,023 copying build/lib/lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-02-14T10:26:01,025 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-02-14T10:26:01,027 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-02-14T10:26:01,029 copying build/lib/lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-02-14T10:26:01,031 copying build/lib/lm_eval/tasks/score/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-02-14T10:26:01,033 copying build/lib/lm_eval/tasks/score/non_greedy.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-02-14T10:26:01,036 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/math 2026-02-14T10:26:01,037 copying build/lib/lm_eval/tasks/score/math/math_grader.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,040 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,042 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,043 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,045 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,047 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,049 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,051 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,053 copying build/lib/lm_eval/tasks/score/math/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,055 copying build/lib/lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,057 copying build/lib/lm_eval/tasks/score/math/utils_math.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,059 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,061 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,063 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,065 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,067 copying build/lib/lm_eval/tasks/score/math/score_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,069 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,070 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,072 copying build/lib/lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,074 copying build/lib/lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,076 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-02-14T10:26:01,077 copying build/lib/lm_eval/tasks/score/non_greedy_summarizer.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-02-14T10:26:01,080 copying build/lib/lm_eval/tasks/score/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-02-14T10:26:01,082 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bangla 2026-02-14T10:26:01,083 copying build/lib/lm_eval/tasks/bangla/bangla_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-02-14T10:26:01,086 copying build/lib/lm_eval/tasks/bangla/bangla_boolqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-02-14T10:26:01,087 copying build/lib/lm_eval/tasks/bangla/bangla_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-02-14T10:26:01,089 copying build/lib/lm_eval/tasks/bangla/bangla_openbookqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-02-14T10:26:01,091 copying build/lib/lm_eval/tasks/bangla/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-02-14T10:26:01,093 copying build/lib/lm_eval/tasks/bangla/bangla_commonsenseqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-02-14T10:26:01,095 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include 2026-02-14T10:26:01,097 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default 2026-02-14T10:26:01,099 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:26:01,100 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:26:01,102 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:26:01,104 copying build/lib/lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:26:01,106 copying build/lib/lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:26:01,108 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:26:01,110 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:26:01,112 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:26:01,114 copying build/lib/lm_eval/tasks/include/default/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-02-14T10:26:01,116 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Dutch 2026-02-14T10:26:01,117 copying build/lib/lm_eval/tasks/include/default/Dutch/_dutch_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-02-14T10:26:01,119 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-02-14T10:26:01,121 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-02-14T10:26:01,122 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-02-14T10:26:01,124 copying build/lib/lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-02-14T10:26:01,126 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-02-14T10:26:01,128 copying build/lib/lm_eval/tasks/include/default/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-02-14T10:26:01,129 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-02-14T10:26:01,132 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:26:01,133 copying build/lib/lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:26:01,134 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:26:01,136 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:26:01,138 copying build/lib/lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:26:01,140 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:26:01,142 copying build/lib/lm_eval/tasks/include/default/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-02-14T10:26:01,144 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Georgian 2026-02-14T10:26:01,145 copying build/lib/lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-02-14T10:26:01,147 copying build/lib/lm_eval/tasks/include/default/Georgian/_georgian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-02-14T10:26:01,149 copying build/lib/lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-02-14T10:26:01,151 copying build/lib/lm_eval/tasks/include/default/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-02-14T10:26:01,153 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Urdu 2026-02-14T10:26:01,154 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-02-14T10:26:01,156 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-02-14T10:26:01,158 copying build/lib/lm_eval/tasks/include/default/Urdu/_urdu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-02-14T10:26:01,159 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-02-14T10:26:01,161 copying build/lib/lm_eval/tasks/include/default/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-02-14T10:26:01,163 copying build/lib/lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-02-14T10:26:01,165 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Japanese 2026-02-14T10:26:01,166 copying build/lib/lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-02-14T10:26:01,168 copying build/lib/lm_eval/tasks/include/default/Japanese/_japanese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-02-14T10:26:01,170 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-02-14T10:26:01,171 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-02-14T10:26:01,173 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-02-14T10:26:01,175 copying build/lib/lm_eval/tasks/include/default/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-02-14T10:26:01,177 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Korean 2026-02-14T10:26:01,178 copying build/lib/lm_eval/tasks/include/default/Korean/_korean_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-02-14T10:26:01,180 copying build/lib/lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-02-14T10:26:01,182 copying build/lib/lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-02-14T10:26:01,183 copying build/lib/lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-02-14T10:26:01,185 copying build/lib/lm_eval/tasks/include/default/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-02-14T10:26:01,188 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Spanish 2026-02-14T10:26:01,189 copying build/lib/lm_eval/tasks/include/default/Spanish/_spanish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-02-14T10:26:01,191 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-02-14T10:26:01,192 copying build/lib/lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-02-14T10:26:01,194 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-02-14T10:26:01,196 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-02-14T10:26:01,198 copying build/lib/lm_eval/tasks/include/default/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-02-14T10:26:01,200 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-02-14T10:26:01,202 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:26:01,203 copying build/lib/lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:26:01,205 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:26:01,207 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:26:01,209 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:26:01,211 copying build/lib/lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:26:01,213 copying build/lib/lm_eval/tasks/include/default/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-02-14T10:26:01,215 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Telugu 2026-02-14T10:26:01,216 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-02-14T10:26:01,218 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-02-14T10:26:01,220 copying build/lib/lm_eval/tasks/include/default/Telugu/_telugu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-02-14T10:26:01,222 copying build/lib/lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-02-14T10:26:01,223 copying build/lib/lm_eval/tasks/include/default/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-02-14T10:26:01,225 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-02-14T10:26:01,227 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-02-14T10:26:01,229 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Portuguese 2026-02-14T10:26:01,230 copying build/lib/lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-02-14T10:26:01,232 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-02-14T10:26:01,234 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-02-14T10:26:01,236 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-02-14T10:26:01,238 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-02-14T10:26:01,240 copying build/lib/lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-02-14T10:26:01,241 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-02-14T10:26:01,243 copying build/lib/lm_eval/tasks/include/default/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-02-14T10:26:01,245 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-02-14T10:26:01,247 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hungarian 2026-02-14T10:26:01,248 copying build/lib/lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-02-14T10:26:01,250 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-02-14T10:26:01,252 copying build/lib/lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-02-14T10:26:01,253 copying build/lib/lm_eval/tasks/include/default/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-02-14T10:26:01,255 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-02-14T10:26:01,257 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-02-14T10:26:01,259 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Kazakh 2026-02-14T10:26:01,260 copying build/lib/lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-02-14T10:26:01,262 copying build/lib/lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-02-14T10:26:01,264 copying build/lib/lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-02-14T10:26:01,266 copying build/lib/lm_eval/tasks/include/default/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-02-14T10:26:01,268 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Malayalam 2026-02-14T10:26:01,269 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-02-14T10:26:01,271 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-02-14T10:26:01,273 copying build/lib/lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-02-14T10:26:01,275 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-02-14T10:26:01,276 copying build/lib/lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-02-14T10:26:01,278 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-02-14T10:26:01,280 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-02-14T10:26:01,282 copying build/lib/lm_eval/tasks/include/default/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-02-14T10:26:01,284 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-02-14T10:26:01,286 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Uzbek 2026-02-14T10:26:01,287 copying build/lib/lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-02-14T10:26:01,289 copying build/lib/lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-02-14T10:26:01,291 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-02-14T10:26:01,293 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-02-14T10:26:01,294 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-02-14T10:26:01,296 copying build/lib/lm_eval/tasks/include/default/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-02-14T10:26:01,298 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-02-14T10:26:01,300 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Persian 2026-02-14T10:26:01,301 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-02-14T10:26:01,303 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-02-14T10:26:01,305 copying build/lib/lm_eval/tasks/include/default/Persian/_persian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-02-14T10:26:01,307 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-02-14T10:26:01,309 copying build/lib/lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-02-14T10:26:01,311 copying build/lib/lm_eval/tasks/include/default/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-02-14T10:26:01,313 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-02-14T10:26:01,314 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-02-14T10:26:01,317 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:26:01,318 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:26:01,320 copying build/lib/lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:26:01,322 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:26:01,323 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:26:01,325 copying build/lib/lm_eval/tasks/include/default/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:26:01,327 copying build/lib/lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-02-14T10:26:01,329 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Belarusian 2026-02-14T10:26:01,330 copying build/lib/lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-02-14T10:26:01,331 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-02-14T10:26:01,333 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-02-14T10:26:01,335 copying build/lib/lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-02-14T10:26:01,336 copying build/lib/lm_eval/tasks/include/default/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-02-14T10:26:01,338 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-02-14T10:26:01,340 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hebrew 2026-02-14T10:26:01,341 copying build/lib/lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-02-14T10:26:01,343 copying build/lib/lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-02-14T10:26:01,345 copying build/lib/lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-02-14T10:26:01,347 copying build/lib/lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-02-14T10:26:01,349 copying build/lib/lm_eval/tasks/include/default/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-02-14T10:26:01,351 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Malay 2026-02-14T10:26:01,352 copying build/lib/lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-02-14T10:26:01,354 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-02-14T10:26:01,356 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-02-14T10:26:01,358 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-02-14T10:26:01,360 copying build/lib/lm_eval/tasks/include/default/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-02-14T10:26:01,362 copying build/lib/lm_eval/tasks/include/default/Malay/_malay_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-02-14T10:26:01,364 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Bengali 2026-02-14T10:26:01,365 copying build/lib/lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-02-14T10:26:01,367 copying build/lib/lm_eval/tasks/include/default/Bengali/_bengali_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-02-14T10:26:01,369 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-02-14T10:26:01,371 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-02-14T10:26:01,373 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-02-14T10:26:01,374 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-02-14T10:26:01,376 copying build/lib/lm_eval/tasks/include/default/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-02-14T10:26:01,378 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,379 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,381 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,383 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,385 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,387 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,388 copying build/lib/lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,390 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,392 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,394 copying build/lib/lm_eval/tasks/include/default/Chinese/_chinese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,396 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,397 copying build/lib/lm_eval/tasks/include/default/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-02-14T10:26:01,400 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Polish 2026-02-14T10:26:01,401 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-02-14T10:26:01,403 copying build/lib/lm_eval/tasks/include/default/Polish/_polish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-02-14T10:26:01,405 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-02-14T10:26:01,407 copying build/lib/lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-02-14T10:26:01,408 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-02-14T10:26:01,410 copying build/lib/lm_eval/tasks/include/default/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-02-14T10:26:01,413 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Estonian 2026-02-14T10:26:01,414 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-02-14T10:26:01,416 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-02-14T10:26:01,417 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-02-14T10:26:01,419 copying build/lib/lm_eval/tasks/include/default/Estonian/_estonian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-02-14T10:26:01,421 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-02-14T10:26:01,422 copying build/lib/lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-02-14T10:26:01,424 copying build/lib/lm_eval/tasks/include/default/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-02-14T10:26:01,426 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-02-14T10:26:01,428 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Tagalog 2026-02-14T10:26:01,429 copying build/lib/lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-02-14T10:26:01,431 copying build/lib/lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-02-14T10:26:01,433 copying build/lib/lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-02-14T10:26:01,435 copying build/lib/lm_eval/tasks/include/default/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-02-14T10:26:01,437 copying build/lib/lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-02-14T10:26:01,440 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Tamil 2026-02-14T10:26:01,441 copying build/lib/lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-02-14T10:26:01,443 copying build/lib/lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-02-14T10:26:01,444 copying build/lib/lm_eval/tasks/include/default/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-02-14T10:26:01,446 copying build/lib/lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-02-14T10:26:01,448 copying build/lib/lm_eval/tasks/include/default/Tamil/_tamil_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-02-14T10:26:01,450 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Croatian 2026-02-14T10:26:01,451 copying build/lib/lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-02-14T10:26:01,453 copying build/lib/lm_eval/tasks/include/default/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-02-14T10:26:01,455 copying build/lib/lm_eval/tasks/include/default/Croatian/_croatian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-02-14T10:26:01,457 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-02-14T10:26:01,459 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-02-14T10:26:01,461 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-02-14T10:26:01,463 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Indonesian 2026-02-14T10:26:01,464 copying build/lib/lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-02-14T10:26:01,466 copying build/lib/lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-02-14T10:26:01,468 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-02-14T10:26:01,470 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-02-14T10:26:01,472 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-02-14T10:26:01,474 copying build/lib/lm_eval/tasks/include/default/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-02-14T10:26:01,475 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-02-14T10:26:01,477 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-02-14T10:26:01,480 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Finnish 2026-02-14T10:26:01,481 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-02-14T10:26:01,483 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-02-14T10:26:01,485 copying build/lib/lm_eval/tasks/include/default/Finnish/_finnish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-02-14T10:26:01,486 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-02-14T10:26:01,488 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-02-14T10:26:01,490 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-02-14T10:26:01,491 copying build/lib/lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-02-14T10:26:01,493 copying build/lib/lm_eval/tasks/include/default/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-02-14T10:26:01,495 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Albanian 2026-02-14T10:26:01,496 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-02-14T10:26:01,498 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-02-14T10:26:01,500 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-02-14T10:26:01,502 copying build/lib/lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-02-14T10:26:01,504 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-02-14T10:26:01,506 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-02-14T10:26:01,508 copying build/lib/lm_eval/tasks/include/default/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-02-14T10:26:01,510 copying build/lib/lm_eval/tasks/include/default/Albanian/_albanian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-02-14T10:26:01,512 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Serbian 2026-02-14T10:26:01,513 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-02-14T10:26:01,515 copying build/lib/lm_eval/tasks/include/default/Serbian/_serbian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-02-14T10:26:01,517 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-02-14T10:26:01,518 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-02-14T10:26:01,520 copying build/lib/lm_eval/tasks/include/default/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-02-14T10:26:01,522 copying build/lib/lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-02-14T10:26:01,524 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,525 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,527 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,529 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,531 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,532 copying build/lib/lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,534 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,536 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,538 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,540 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,542 copying build/lib/lm_eval/tasks/include/default/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,544 copying build/lib/lm_eval/tasks/include/default/Russian/_russian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-02-14T10:26:01,547 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Italian 2026-02-14T10:26:01,548 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-02-14T10:26:01,550 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-02-14T10:26:01,551 copying build/lib/lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-02-14T10:26:01,553 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-02-14T10:26:01,555 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-02-14T10:26:01,557 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-02-14T10:26:01,558 copying build/lib/lm_eval/tasks/include/default/Italian/_italian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-02-14T10:26:01,560 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-02-14T10:26:01,562 copying build/lib/lm_eval/tasks/include/default/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-02-14T10:26:01,564 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:26:01,565 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:26:01,567 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:26:01,569 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:26:01,570 copying build/lib/lm_eval/tasks/include/default/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:26:01,572 copying build/lib/lm_eval/tasks/include/default/North Macedonian/_include_base_44_north macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:26:01,574 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:26:01,576 copying build/lib/lm_eval/tasks/include/default/North Macedonian/_north macedonian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-02-14T10:26:01,578 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/German 2026-02-14T10:26:01,579 copying build/lib/lm_eval/tasks/include/default/German/_german_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-02-14T10:26:01,581 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-02-14T10:26:01,583 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-02-14T10:26:01,585 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-02-14T10:26:01,587 copying build/lib/lm_eval/tasks/include/default/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-02-14T10:26:01,589 copying build/lib/lm_eval/tasks/include/default/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-02-14T10:26:01,591 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Armenian 2026-02-14T10:26:01,592 copying build/lib/lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-02-14T10:26:01,594 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-02-14T10:26:01,596 copying build/lib/lm_eval/tasks/include/default/Armenian/_armenian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-02-14T10:26:01,598 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-02-14T10:26:01,599 copying build/lib/lm_eval/tasks/include/default/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-02-14T10:26:01,601 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-02-14T10:26:01,603 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-02-14T10:26:01,605 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Basque 2026-02-14T10:26:01,606 copying build/lib/lm_eval/tasks/include/default/Basque/_basque_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-02-14T10:26:01,608 copying build/lib/lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-02-14T10:26:01,610 copying build/lib/lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-02-14T10:26:01,611 copying build/lib/lm_eval/tasks/include/default/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-02-14T10:26:01,613 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Greek 2026-02-14T10:26:01,614 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-02-14T10:26:01,616 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-02-14T10:26:01,618 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-02-14T10:26:01,619 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-02-14T10:26:01,621 copying build/lib/lm_eval/tasks/include/default/Greek/_greek_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-02-14T10:26:01,623 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-02-14T10:26:01,625 copying build/lib/lm_eval/tasks/include/default/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-02-14T10:26:01,626 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-02-14T10:26:01,628 copying build/lib/lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-02-14T10:26:01,630 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-02-14T10:26:01,632 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/French 2026-02-14T10:26:01,633 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-02-14T10:26:01,635 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-02-14T10:26:01,637 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-02-14T10:26:01,639 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-02-14T10:26:01,640 copying build/lib/lm_eval/tasks/include/default/French/_french_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-02-14T10:26:01,642 copying build/lib/lm_eval/tasks/include/default/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-02-14T10:26:01,644 copying build/lib/lm_eval/tasks/include/default/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-02-14T10:26:01,646 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-02-14T10:26:01,648 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,649 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,651 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,652 copying build/lib/lm_eval/tasks/include/default/Hindi/_hindi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,654 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,656 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,658 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,659 copying build/lib/lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,661 copying build/lib/lm_eval/tasks/include/default/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,663 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,664 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,666 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-02-14T10:26:01,668 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Arabic 2026-02-14T10:26:01,669 copying build/lib/lm_eval/tasks/include/default/Arabic/_arabic_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-02-14T10:26:01,671 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-02-14T10:26:01,673 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-02-14T10:26:01,675 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-02-14T10:26:01,677 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-02-14T10:26:01,678 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-02-14T10:26:01,680 copying build/lib/lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-02-14T10:26:01,682 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-02-14T10:26:01,683 copying build/lib/lm_eval/tasks/include/default/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-02-14T10:26:01,686 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Turkish 2026-02-14T10:26:01,687 copying build/lib/lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-02-14T10:26:01,688 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-02-14T10:26:01,690 copying build/lib/lm_eval/tasks/include/default/Turkish/_turkish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-02-14T10:26:01,692 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-02-14T10:26:01,693 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-02-14T10:26:01,695 copying build/lib/lm_eval/tasks/include/default/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-02-14T10:26:01,697 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-02-14T10:26:01,699 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:26:01,700 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:26:01,702 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:26:01,704 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:26:01,705 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:26:01,707 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:26:01,709 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:26:01,711 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:26:01,712 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:26:01,714 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-02-14T10:26:01,717 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Nepali 2026-02-14T10:26:01,718 copying build/lib/lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-02-14T10:26:01,721 copying build/lib/lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-02-14T10:26:01,723 copying build/lib/lm_eval/tasks/include/default/Nepali/_nepali_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-02-14T10:26:01,725 copying build/lib/lm_eval/tasks/include/default/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-02-14T10:26:01,727 copying build/lib/lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-02-14T10:26:01,729 copying build/lib/lm_eval/tasks/include/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include 2026-02-14T10:26:01,733 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en 2026-02-14T10:26:01,734 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:26:01,736 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:26:01,738 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:26:01,740 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:26:01,742 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:26:01,745 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:26:01,747 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:26:01,749 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:26:01,751 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-02-14T10:26:01,755 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:26:01,756 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:26:01,760 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:26:01,763 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:26:01,766 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:26:01,770 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:26:01,774 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:26:01,778 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:26:01,781 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-02-14T10:26:01,786 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:26:01,787 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:26:01,789 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:26:01,791 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:26:01,793 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:26:01,796 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:26:01,798 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-02-14T10:26:01,800 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Georgian 2026-02-14T10:26:01,802 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-02-14T10:26:01,804 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-02-14T10:26:01,806 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-02-14T10:26:01,808 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-02-14T10:26:01,811 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:26:01,813 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:26:01,815 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:26:01,819 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:26:01,824 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:26:01,827 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:26:01,829 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-02-14T10:26:01,832 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:26:01,833 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:26:01,835 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:26:01,837 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:26:01,839 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:26:01,841 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:26:01,842 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-02-14T10:26:01,845 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:26:01,846 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:26:01,850 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:26:01,852 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:26:01,854 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:26:01,855 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-02-14T10:26:01,858 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:26:01,859 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:26:01,861 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:26:01,863 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:26:01,864 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:26:01,866 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:26:01,868 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:26:01,870 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-02-14T10:26:01,872 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:26:01,873 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:26:01,875 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:26:01,876 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:26:01,878 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:26:01,880 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:26:01,881 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-02-14T10:26:01,883 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:26:01,884 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:26:01,886 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:26:01,888 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:26:01,889 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:26:01,891 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:26:01,893 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:26:01,895 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-02-14T10:26:01,897 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:26:01,898 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:26:01,900 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:26:01,902 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:26:01,903 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:26:01,905 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:26:01,907 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:26:01,908 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:26:01,910 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:26:01,912 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-02-14T10:26:01,914 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:26:01,915 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:26:01,917 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:26:01,918 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:26:01,920 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:26:01,922 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:26:01,923 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-02-14T10:26:01,926 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Kazakh 2026-02-14T10:26:01,927 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-02-14T10:26:01,929 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-02-14T10:26:01,930 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-02-14T10:26:01,932 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-02-14T10:26:01,934 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:26:01,936 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:26:01,937 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:26:01,939 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:26:01,941 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:26:01,943 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:26:01,944 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:26:01,946 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:26:01,948 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:26:01,950 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-02-14T10:26:01,952 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:26:01,953 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:26:01,955 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:26:01,957 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:26:01,958 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:26:01,960 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:26:01,961 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:26:01,963 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-02-14T10:26:01,966 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:26:01,967 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:26:01,968 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:26:01,970 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:26:01,972 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:26:01,974 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:26:01,975 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:26:01,977 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:26:01,979 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-02-14T10:26:01,981 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:26:01,982 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:26:01,984 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:26:01,986 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:26:01,987 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:26:01,989 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:26:01,990 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-02-14T10:26:01,993 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:26:01,993 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:26:01,995 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:26:01,997 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:26:01,999 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:26:02,001 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:26:02,002 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-02-14T10:26:02,005 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:26:02,006 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:26:02,008 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:26:02,009 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:26:02,011 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:26:02,013 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-02-14T10:26:02,015 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:26:02,016 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:26:02,018 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:26:02,020 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:26:02,022 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:26:02,023 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:26:02,025 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-02-14T10:26:02,028 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:26:02,029 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:26:02,030 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:26:02,032 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:26:02,034 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:26:02,035 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:26:02,037 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:26:02,039 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-02-14T10:26:02,041 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,042 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,044 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,046 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,048 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,049 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,051 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,053 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,055 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,056 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,058 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,060 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-02-14T10:26:02,063 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:26:02,064 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:26:02,065 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:26:02,067 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:26:02,069 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:26:02,071 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:26:02,072 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-02-14T10:26:02,075 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:26:02,076 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:26:02,078 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:26:02,079 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:26:02,081 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:26:02,083 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:26:02,085 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:26:02,087 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:26:02,088 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-02-14T10:26:02,090 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:26:02,091 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:26:02,093 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:26:02,095 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:26:02,097 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:26:02,099 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-02-14T10:26:02,101 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:26:02,102 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:26:02,103 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:26:02,105 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:26:02,107 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:26:02,109 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-02-14T10:26:02,111 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:26:02,112 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:26:02,114 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:26:02,116 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:26:02,117 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:26:02,119 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:26:02,121 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-02-14T10:26:02,123 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:26:02,124 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:26:02,126 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:26:02,128 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:26:02,129 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:26:02,131 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:26:02,133 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:26:02,135 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:26:02,136 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-02-14T10:26:02,139 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:26:02,140 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:26:02,142 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:26:02,144 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:26:02,146 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:26:02,147 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:26:02,149 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:26:02,151 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:26:02,153 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-02-14T10:26:02,156 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:26:02,157 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:26:02,159 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:26:02,160 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:26:02,162 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:26:02,164 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:26:02,166 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:26:02,168 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:26:02,169 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-02-14T10:26:02,172 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:26:02,173 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:26:02,175 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:26:02,177 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:26:02,178 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:26:02,180 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:26:02,182 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-02-14T10:26:02,184 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,185 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,187 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,189 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,191 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,193 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,195 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,196 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,198 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,200 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,202 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,204 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-02-14T10:26:02,206 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:26:02,207 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:26:02,209 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:26:02,211 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:26:02,213 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:26:02,215 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:26:02,217 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:26:02,219 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:26:02,221 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:26:02,223 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-02-14T10:26:02,225 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:26:02,227 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:26:02,229 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/_north macedonian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:26:02,230 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:26:02,232 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:26:02,234 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:26:02,236 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:26:02,238 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-02-14T10:26:02,240 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:26:02,241 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:26:02,243 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:26:02,245 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:26:02,247 copying build/lib/lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:26:02,249 copying build/lib/lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:26:02,251 copying build/lib/lm_eval/tasks/include/few_shot_en/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-02-14T10:26:02,254 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:26:02,255 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:26:02,257 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:26:02,258 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:26:02,260 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:26:02,262 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:26:02,264 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:26:02,265 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-02-14T10:26:02,268 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Basque 2026-02-14T10:26:02,269 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-02-14T10:26:02,271 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-02-14T10:26:02,273 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-02-14T10:26:02,275 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-02-14T10:26:02,277 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:26:02,278 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:26:02,280 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:26:02,282 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:26:02,283 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:26:02,285 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:26:02,287 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:26:02,289 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:26:02,291 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:26:02,292 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:26:02,294 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-02-14T10:26:02,296 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:26:02,297 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:26:02,299 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:26:02,301 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:26:02,303 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:26:02,304 copying build/lib/lm_eval/tasks/include/few_shot_en/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:26:02,306 copying build/lib/lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:26:02,308 copying build/lib/lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:26:02,310 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-02-14T10:26:02,312 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,313 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,315 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,317 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,319 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,321 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,323 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,325 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,326 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,328 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,330 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,332 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-02-14T10:26:02,334 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:26:02,335 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:26:02,337 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:26:02,339 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:26:02,341 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:26:02,343 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:26:02,344 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:26:02,346 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:26:02,348 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:26:02,350 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-02-14T10:26:02,352 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:26:02,353 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:26:02,355 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:26:02,357 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:26:02,359 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:26:02,361 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:26:02,363 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:26:02,365 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-02-14T10:26:02,367 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:26:02,368 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:26:02,370 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:26:02,372 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:26:02,374 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:26:02,376 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:26:02,377 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:26:02,379 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:26:02,381 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:26:02,382 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-02-14T10:26:02,385 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:26:02,386 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:26:02,388 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:26:02,390 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:26:02,392 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:26:02,393 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-02-14T10:26:02,396 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og 2026-02-14T10:26:02,398 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:26:02,399 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:26:02,401 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:26:02,403 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:26:02,404 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:26:02,406 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:26:02,408 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:26:02,410 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:26:02,412 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-02-14T10:26:02,414 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:26:02,415 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:26:02,417 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:26:02,419 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:26:02,421 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:26:02,423 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:26:02,424 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:26:02,426 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:26:02,428 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-02-14T10:26:02,430 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:26:02,431 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:26:02,433 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:26:02,435 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:26:02,437 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:26:02,439 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:26:02,441 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-02-14T10:26:02,443 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Georgian 2026-02-14T10:26:02,444 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-02-14T10:26:02,446 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-02-14T10:26:02,448 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-02-14T10:26:02,450 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-02-14T10:26:02,452 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:26:02,453 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:26:02,455 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:26:02,457 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:26:02,459 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:26:02,461 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:26:02,462 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-02-14T10:26:02,465 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:26:02,466 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:26:02,468 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:26:02,469 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:26:02,471 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:26:02,473 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:26:02,474 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-02-14T10:26:02,477 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:26:02,478 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:26:02,480 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:26:02,482 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:26:02,484 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:26:02,486 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-02-14T10:26:02,488 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:26:02,489 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:26:02,491 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:26:02,493 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:26:02,495 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:26:02,496 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:26:02,498 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:26:02,500 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-02-14T10:26:02,502 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:26:02,503 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:26:02,505 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:26:02,507 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:26:02,509 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:26:02,511 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:26:02,513 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-02-14T10:26:02,515 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:26:02,516 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:26:02,518 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:26:02,520 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:26:02,522 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:26:02,524 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:26:02,526 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:26:02,529 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-02-14T10:26:02,532 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:26:02,533 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:26:02,535 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:26:02,538 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:26:02,540 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:26:02,542 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:26:02,544 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:26:02,546 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:26:02,549 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:26:02,551 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-02-14T10:26:02,554 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:26:02,555 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:26:02,557 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:26:02,560 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:26:02,562 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:26:02,564 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:26:02,566 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-02-14T10:26:02,569 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Kazakh 2026-02-14T10:26:02,571 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-02-14T10:26:02,573 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-02-14T10:26:02,575 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-02-14T10:26:02,578 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-02-14T10:26:02,580 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:26:02,582 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:26:02,584 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:26:02,586 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:26:02,588 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:26:02,591 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:26:02,593 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:26:02,595 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:26:02,597 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:26:02,599 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-02-14T10:26:02,602 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:26:02,603 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:26:02,605 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:26:02,608 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:26:02,610 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:26:02,612 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:26:02,614 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:26:02,616 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-02-14T10:26:02,619 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:26:02,620 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:26:02,622 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:26:02,624 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:26:02,626 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:26:02,628 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:26:02,629 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:26:02,631 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:26:02,633 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-02-14T10:26:02,635 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:26:02,636 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:26:02,638 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:26:02,640 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:26:02,642 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:26:02,643 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:26:02,645 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-02-14T10:26:02,648 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:26:02,649 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:26:02,651 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:26:02,652 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:26:02,654 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:26:02,656 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:26:02,658 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-02-14T10:26:02,660 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:26:02,661 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:26:02,663 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:26:02,665 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:26:02,667 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:26:02,668 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-02-14T10:26:02,671 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:26:02,672 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:26:02,673 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:26:02,675 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:26:02,677 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:26:02,679 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:26:02,680 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-02-14T10:26:02,683 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:26:02,684 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:26:02,686 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:26:02,687 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:26:02,689 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:26:02,691 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:26:02,692 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:26:02,694 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-02-14T10:26:02,697 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,698 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,700 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,702 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,704 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,706 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,708 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,709 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,711 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,712 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,714 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,716 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-02-14T10:26:02,718 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:26:02,719 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:26:02,721 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:26:02,722 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:26:02,724 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:26:02,726 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:26:02,728 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-02-14T10:26:02,730 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:26:02,731 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:26:02,733 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:26:02,735 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:26:02,737 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:26:02,739 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:26:02,741 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:26:02,743 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:26:02,745 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-02-14T10:26:02,747 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:26:02,748 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:26:02,750 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:26:02,752 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:26:02,753 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:26:02,755 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-02-14T10:26:02,757 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:26:02,759 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:26:02,760 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:26:02,762 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:26:02,764 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:26:02,766 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-02-14T10:26:02,768 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:26:02,769 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:26:02,771 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:26:02,772 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:26:02,774 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:26:02,776 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:26:02,778 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-02-14T10:26:02,781 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:26:02,782 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:26:02,784 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:26:02,785 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:26:02,787 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:26:02,789 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:26:02,791 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:26:02,793 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:26:02,795 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-02-14T10:26:02,797 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:26:02,798 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:26:02,800 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:26:02,802 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:26:02,803 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:26:02,805 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:26:02,807 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:26:02,809 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:26:02,810 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-02-14T10:26:02,813 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:26:02,814 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:26:02,816 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:26:02,817 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:26:02,819 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:26:02,821 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:26:02,823 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:26:02,824 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:26:02,826 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-02-14T10:26:02,828 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:26:02,829 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:26:02,831 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:26:02,833 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:26:02,834 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:26:02,836 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:26:02,838 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-02-14T10:26:02,840 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,841 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,843 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,845 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,847 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,849 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,850 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,852 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,854 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,855 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,857 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,859 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-02-14T10:26:02,861 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:26:02,862 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:26:02,864 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:26:02,866 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:26:02,867 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:26:02,869 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:26:02,871 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:26:02,873 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:26:02,875 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:26:02,876 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-02-14T10:26:02,879 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:26:02,880 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:26:02,882 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:26:02,883 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/_north macedonian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:26:02,885 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:26:02,887 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:26:02,889 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:26:02,891 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-02-14T10:26:02,893 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:26:02,894 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:26:02,896 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:26:02,898 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:26:02,900 copying build/lib/lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:26:02,901 copying build/lib/lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:26:02,903 copying build/lib/lm_eval/tasks/include/few_shot_og/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-02-14T10:26:02,906 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:26:02,907 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:26:02,909 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:26:02,911 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:26:02,913 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:26:02,915 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:26:02,917 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:26:02,919 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-02-14T10:26:02,921 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Basque 2026-02-14T10:26:02,922 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-02-14T10:26:02,924 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-02-14T10:26:02,926 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-02-14T10:26:02,927 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-02-14T10:26:02,930 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:26:02,931 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:26:02,933 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:26:02,934 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:26:02,936 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:26:02,938 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:26:02,939 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:26:02,941 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:26:02,942 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:26:02,944 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:26:02,946 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-02-14T10:26:02,948 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:26:02,949 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:26:02,951 copying build/lib/lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:26:02,953 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:26:02,955 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:26:02,957 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:26:02,958 copying build/lib/lm_eval/tasks/include/few_shot_og/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:26:02,960 copying build/lib/lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:26:02,962 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-02-14T10:26:02,964 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,965 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,967 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,969 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,971 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,973 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,974 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,976 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,978 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,979 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,981 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,983 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-02-14T10:26:02,985 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:26:02,986 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:26:02,988 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:26:02,990 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:26:02,992 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:26:02,993 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:26:02,995 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:26:02,997 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:26:02,999 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:26:03,001 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-02-14T10:26:03,003 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:26:03,004 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:26:03,006 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:26:03,008 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:26:03,009 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:26:03,011 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:26:03,013 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:26:03,014 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-02-14T10:26:03,017 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:26:03,018 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:26:03,019 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:26:03,021 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:26:03,023 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:26:03,025 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:26:03,027 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:26:03,029 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:26:03,031 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:26:03,033 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-02-14T10:26:03,036 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:26:03,037 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:26:03,040 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:26:03,041 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:26:03,043 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:26:03,045 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-02-14T10:26:03,047 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,048 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,050 copying build/lib/lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,052 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,053 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,055 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,057 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,058 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,060 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,061 copying build/lib/lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,063 copying build/lib/lm_eval/tasks/mmlu_pro/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,065 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,067 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,069 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,071 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,072 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,074 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,076 copying build/lib/lm_eval/tasks/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,077 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-02-14T10:26:03,080 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,081 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,082 copying build/lib/lm_eval/tasks/mmlu-pro-plus/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,084 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,086 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,087 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,089 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,091 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,092 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,094 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,095 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,097 copying build/lib/lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,099 copying build/lib/lm_eval/tasks/mmlu-pro-plus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,100 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,102 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,104 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,105 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,107 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,109 copying build/lib/lm_eval/tasks/mmlu-pro-plus/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-02-14T10:26:03,111 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/winogrande 2026-02-14T10:26:03,112 copying build/lib/lm_eval/tasks/winogrande/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2026-02-14T10:26:03,114 copying build/lib/lm_eval/tasks/winogrande/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2026-02-14T10:26:03,116 copying build/lib/lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2026-02-14T10:26:03,119 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/agieval 2026-02-14T10:26:03,120 copying build/lib/lm_eval/tasks/agieval/lsat-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,122 copying build/lib/lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,123 copying build/lib/lm_eval/tasks/agieval/aqua-rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,125 copying build/lib/lm_eval/tasks/agieval/gaokao-english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,127 copying build/lib/lm_eval/tasks/agieval/math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,129 copying build/lib/lm_eval/tasks/agieval/gaokao-history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,131 copying build/lib/lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,133 copying build/lib/lm_eval/tasks/agieval/sat-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,134 copying build/lib/lm_eval/tasks/agieval/agieval_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,136 copying build/lib/lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,138 copying build/lib/lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,140 copying build/lib/lm_eval/tasks/agieval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,142 copying build/lib/lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,144 copying build/lib/lm_eval/tasks/agieval/gaokao-biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,145 copying build/lib/lm_eval/tasks/agieval/lsat-lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,147 copying build/lib/lm_eval/tasks/agieval/gaokao-geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,149 copying build/lib/lm_eval/tasks/agieval/gaokao-physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,150 copying build/lib/lm_eval/tasks/agieval/agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,152 copying build/lib/lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,154 copying build/lib/lm_eval/tasks/agieval/logiqa-zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,156 copying build/lib/lm_eval/tasks/agieval/agieval_cn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,158 copying build/lib/lm_eval/tasks/agieval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,160 copying build/lib/lm_eval/tasks/agieval/sat-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,161 copying build/lib/lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,163 copying build/lib/lm_eval/tasks/agieval/agieval_nous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,165 copying build/lib/lm_eval/tasks/agieval/lsat-rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,167 copying build/lib/lm_eval/tasks/agieval/logiqa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-02-14T10:26:03,170 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arab_culture 2026-02-14T10:26:03,171 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,173 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,175 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,177 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,178 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,180 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,182 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,184 copying build/lib/lm_eval/tasks/arab_culture/prompts.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,186 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,188 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,189 copying build/lib/lm_eval/tasks/arab_culture/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,191 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,193 copying build/lib/lm_eval/tasks/arab_culture/utils_mcq.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,195 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,196 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_ksa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,198 copying build/lib/lm_eval/tasks/arab_culture/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,200 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_uae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,202 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,204 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,206 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_levant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,208 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,209 copying build/lib/lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,211 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-02-14T10:26:03,213 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/humaneval 2026-02-14T10:26:03,214 copying build/lib/lm_eval/tasks/humaneval/humaneval_64.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-02-14T10:26:03,216 copying build/lib/lm_eval/tasks/humaneval/humaneval_64_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-02-14T10:26:03,218 copying build/lib/lm_eval/tasks/humaneval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-02-14T10:26:03,220 copying build/lib/lm_eval/tasks/humaneval/humaneval_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-02-14T10:26:03,222 copying build/lib/lm_eval/tasks/humaneval/humaneval_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-02-14T10:26:03,224 copying build/lib/lm_eval/tasks/humaneval/humaneval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-02-14T10:26:03,225 copying build/lib/lm_eval/tasks/humaneval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-02-14T10:26:03,228 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi 2026-02-14T10:26:03,230 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,231 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,233 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,235 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,237 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,240 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,242 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,244 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,246 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,248 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,250 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,251 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,253 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,255 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,257 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,259 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,261 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,263 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,265 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,266 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,268 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,270 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,272 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,274 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,275 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,277 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,279 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,281 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,283 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,285 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,286 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,288 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,290 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,291 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,293 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,295 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,297 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,298 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,300 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,302 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,304 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,306 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,307 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,309 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,311 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,312 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,314 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,316 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,318 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,320 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,322 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,323 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,325 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,328 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,330 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,332 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,335 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,337 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,339 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,342 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,344 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,346 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,348 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,351 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,353 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,355 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,357 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-02-14T10:26:03,361 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,362 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,365 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,367 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,369 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,372 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,374 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,377 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,379 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,381 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,384 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,386 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,388 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,391 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,393 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,395 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,398 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,400 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,402 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,404 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,407 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,409 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,411 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,414 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,416 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,418 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,421 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,423 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,425 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,427 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,429 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,430 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,432 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,433 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,435 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-02-14T10:26:03,438 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,439 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,441 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,442 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,444 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,446 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,447 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,449 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,451 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,453 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,454 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,456 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,458 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,460 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,462 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,463 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,465 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,467 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,469 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,471 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,473 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,475 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,476 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,478 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,480 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,482 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,484 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,485 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,488 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,490 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,493 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,495 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,497 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,499 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,500 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,502 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,504 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-02-14T10:26:03,506 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,508 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,510 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,512 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,514 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,516 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,517 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,519 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,521 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,522 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,524 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,525 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,527 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,529 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,530 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,532 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,534 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,536 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,537 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,539 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,541 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,543 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,544 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,547 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,548 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,550 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,552 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,554 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,556 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,558 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,559 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,561 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,563 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,564 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-02-14T10:26:03,567 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turblimp 2026-02-14T10:26:03,568 copying build/lib/lm_eval/tasks/turblimp/npi_licensing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,570 copying build/lib/lm_eval/tasks/turblimp/argument_structure_transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,571 copying build/lib/lm_eval/tasks/turblimp/quantifiers.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,573 copying build/lib/lm_eval/tasks/turblimp/passives.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,574 copying build/lib/lm_eval/tasks/turblimp/binding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,576 copying build/lib/lm_eval/tasks/turblimp/determiners.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,578 copying build/lib/lm_eval/tasks/turblimp/anaphor_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,580 copying build/lib/lm_eval/tasks/turblimp/relative_clauses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,581 copying build/lib/lm_eval/tasks/turblimp/subject_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,583 copying build/lib/lm_eval/tasks/turblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,585 copying build/lib/lm_eval/tasks/turblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,587 copying build/lib/lm_eval/tasks/turblimp/scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,588 copying build/lib/lm_eval/tasks/turblimp/turblimp_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,590 copying build/lib/lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,592 copying build/lib/lm_eval/tasks/turblimp/island_effects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,594 copying build/lib/lm_eval/tasks/turblimp/nominalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,595 copying build/lib/lm_eval/tasks/turblimp/irregular_forms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,597 copying build/lib/lm_eval/tasks/turblimp/suspended_affixation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,599 copying build/lib/lm_eval/tasks/turblimp/ellipsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-02-14T10:26:03,602 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/blimp 2026-02-14T10:26:03,603 copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,605 copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,607 copying build/lib/lm_eval/tasks/blimp/causative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,608 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,610 copying build/lib/lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,612 copying build/lib/lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,613 copying build/lib/lm_eval/tasks/blimp/_blimp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,615 copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,617 copying build/lib/lm_eval/tasks/blimp/only_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,618 copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,620 copying build/lib/lm_eval/tasks/blimp/npi_present_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,622 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,623 copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,625 copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,626 copying build/lib/lm_eval/tasks/blimp/complex_NP_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,628 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,630 copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,631 copying build/lib/lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,633 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,635 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,636 copying build/lib/lm_eval/tasks/blimp/adjunct_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,638 copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,640 copying build/lib/lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,642 copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,644 copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,645 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,647 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,649 copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,651 copying build/lib/lm_eval/tasks/blimp/transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,652 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,654 copying build/lib/lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,656 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,658 copying build/lib/lm_eval/tasks/blimp/intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,659 copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,661 copying build/lib/lm_eval/tasks/blimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,663 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,665 copying build/lib/lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,667 copying build/lib/lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,668 copying build/lib/lm_eval/tasks/blimp/inchoative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,670 copying build/lib/lm_eval/tasks/blimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,672 copying build/lib/lm_eval/tasks/blimp/passive_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,674 copying build/lib/lm_eval/tasks/blimp/npi_present_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,676 copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,678 copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,680 copying build/lib/lm_eval/tasks/blimp/passive_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,682 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,684 copying build/lib/lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,686 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,688 copying build/lib/lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,689 copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,691 copying build/lib/lm_eval/tasks/blimp/generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,693 copying build/lib/lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,695 copying build/lib/lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,697 copying build/lib/lm_eval/tasks/blimp/drop_argument.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,699 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,702 copying build/lib/lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,704 copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,706 copying build/lib/lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,707 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,709 copying build/lib/lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,711 copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,712 copying build/lib/lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,714 copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,716 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,718 copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,720 copying build/lib/lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,722 copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,724 copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,726 copying build/lib/lm_eval/tasks/blimp/wh_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,728 copying build/lib/lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,730 copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-02-14T10:26:03,733 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/storycloze 2026-02-14T10:26:03,734 copying build/lib/lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2026-02-14T10:26:03,736 copying build/lib/lm_eval/tasks/storycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2026-02-14T10:26:03,738 copying build/lib/lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2026-02-14T10:26:03,742 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/multiblimp 2026-02-14T10:26:03,743 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,746 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_pol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,748 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_deu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,750 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nld.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,752 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,754 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fas.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,756 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_spa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,758 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tpn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,760 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ttc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,762 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_krl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,764 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mkd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,766 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_yrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,768 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,781 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,782 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lij.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,784 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hye.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,787 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hyw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,789 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,790 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,793 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_frm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,795 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kxh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,797 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xcl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,799 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_glg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,801 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_myv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,802 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,804 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,806 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kmr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,808 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kpv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,810 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,812 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sah.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,814 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,815 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_cym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,817 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ces.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,819 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_apu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,821 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,823 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_got.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,857 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_rus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,859 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,862 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,865 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_abk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,868 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_aqz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,872 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_cat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,876 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lav.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,881 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_slv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,886 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,892 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_gla.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,896 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_eus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,899 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,902 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,905 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,907 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_uzb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,909 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_san.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,911 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,913 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_isl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,915 copying build/lib/lm_eval/tasks/multiblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,917 copying build/lib/lm_eval/tasks/multiblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,919 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bel.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,921 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:03,923 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_orv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,146 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,148 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_dan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,150 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,153 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_grc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,155 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_urb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,157 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,159 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,161 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ita.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,163 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,165 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_swe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,168 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,170 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,172 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_azz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,174 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_wbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,176 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_urd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,179 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_heb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,181 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ben.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,183 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_aln.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,185 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_uig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,187 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_quc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,190 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,192 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_est.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,194 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_vep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,196 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_koi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,198 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_slk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,201 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_arb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,203 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,205 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_guj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,207 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mdf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,210 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ukr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,212 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xpg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,214 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,216 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sqi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,218 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xnr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,221 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_chu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,223 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hsb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,225 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_gle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,227 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,229 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hun.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,231 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_olo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,233 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nhi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,235 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ell.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,238 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ota.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,240 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-02-14T10:26:04,243 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/drop 2026-02-14T10:26:04,244 copying build/lib/lm_eval/tasks/drop/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2026-02-14T10:26:04,247 copying build/lib/lm_eval/tasks/drop/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2026-02-14T10:26:04,249 copying build/lib/lm_eval/tasks/drop/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2026-02-14T10:26:04,251 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbq 2026-02-14T10:26:04,252 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-02-14T10:26:04,254 copying build/lib/lm_eval/tasks/bbq/bbq_generate_disambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-02-14T10:26:04,256 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-02-14T10:26:04,258 copying build/lib/lm_eval/tasks/bbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-02-14T10:26:04,259 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-02-14T10:26:04,261 copying build/lib/lm_eval/tasks/bbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-02-14T10:26:04,264 copying build/lib/lm_eval/tasks/bbq/bbq_generate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-02-14T10:26:04,266 copying build/lib/lm_eval/tasks/bbq/bbq_generate_ambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-02-14T10:26:04,268 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,269 copying build/lib/lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,271 copying build/lib/lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,273 copying build/lib/lm_eval/tasks/catalan_bench/teca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,274 copying build/lib/lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,276 copying build/lib/lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,278 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,279 copying build/lib/lm_eval/tasks/catalan_bench/cocoteros_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,281 copying build/lib/lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,282 copying build/lib/lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,284 copying build/lib/lm_eval/tasks/catalan_bench/coqcat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,286 copying build/lib/lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,287 copying build/lib/lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,289 copying build/lib/lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,291 copying build/lib/lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,293 copying build/lib/lm_eval/tasks/catalan_bench/xnli_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,294 copying build/lib/lm_eval/tasks/catalan_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,297 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,299 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,300 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,302 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,304 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,305 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,307 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,309 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,311 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,312 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,314 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,316 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,318 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,319 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,321 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,323 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,325 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,327 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,329 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,330 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,332 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-02-14T10:26:04,334 copying build/lib/lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,336 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/phrases_va 2026-02-14T10:26:04,338 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2026-02-14T10:26:04,340 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2026-02-14T10:26:04,342 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2026-02-14T10:26:04,343 copying build/lib/lm_eval/tasks/catalan_bench/catcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,345 copying build/lib/lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,347 copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,349 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,351 copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,352 copying build/lib/lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,354 copying build/lib/lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,356 copying build/lib/lm_eval/tasks/catalan_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,359 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-02-14T10:26:04,360 copying build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va/truthfulqa_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/truthfulqa_va 2026-02-14T10:26:04,362 copying build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/truthfulqa_va 2026-02-14T10:26:04,364 copying build/lib/lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-02-14T10:26:04,367 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench 2026-02-14T10:26:04,368 copying build/lib/lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-02-14T10:26:04,370 copying build/lib/lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-02-14T10:26:04,372 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,373 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,375 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,376 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,378 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,380 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,382 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,383 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,385 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,387 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,388 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,390 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,392 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,393 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,395 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,397 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,399 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,401 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,402 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,404 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-02-14T10:26:04,406 copying build/lib/lm_eval/tasks/portuguese_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-02-14T10:26:04,408 copying build/lib/lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-02-14T10:26:04,410 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmdp 2026-02-14T10:26:04,411 copying build/lib/lm_eval/tasks/wmdp/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-02-14T10:26:04,413 copying build/lib/lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-02-14T10:26:04,414 copying build/lib/lm_eval/tasks/wmdp/_wmdp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-02-14T10:26:04,416 copying build/lib/lm_eval/tasks/wmdp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-02-14T10:26:04,418 copying build/lib/lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-02-14T10:26:04,419 copying build/lib/lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-02-14T10:26:04,421 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/graphwalks 2026-02-14T10:26:04,422 copying build/lib/lm_eval/tasks/graphwalks/graphwalks_1M.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-02-14T10:26:04,424 copying build/lib/lm_eval/tasks/graphwalks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-02-14T10:26:04,426 copying build/lib/lm_eval/tasks/graphwalks/graphwalks_128k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-02-14T10:26:04,428 copying build/lib/lm_eval/tasks/graphwalks/graphwalks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-02-14T10:26:04,429 copying build/lib/lm_eval/tasks/graphwalks/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-02-14T10:26:04,432 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual 2026-02-14T10:26:04,433 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-02-14T10:26:04,435 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-02-14T10:26:04,436 copying build/lib/lm_eval/tasks/lambada_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-02-14T10:26:04,438 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-02-14T10:26:04,440 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-02-14T10:26:04,442 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-02-14T10:26:04,444 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa 2026-02-14T10:26:04,445 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:26:04,446 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:26:04,448 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:26:04,450 copying build/lib/lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:26:04,452 copying build/lib/lm_eval/tasks/gpqa/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:26:04,453 copying build/lib/lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:26:04,455 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-02-14T10:26:04,457 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/generative 2026-02-14T10:26:04,458 copying build/lib/lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-02-14T10:26:04,460 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-02-14T10:26:04,462 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-02-14T10:26:04,463 copying build/lib/lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-02-14T10:26:04,465 copying build/lib/lm_eval/tasks/gpqa/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-02-14T10:26:04,467 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-02-14T10:26:04,468 copying build/lib/lm_eval/tasks/gpqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa 2026-02-14T10:26:04,470 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:26:04,471 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:26:04,473 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:26:04,475 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:26:04,476 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:26:04,478 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:26:04,480 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-02-14T10:26:04,482 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/n_shot 2026-02-14T10:26:04,483 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-02-14T10:26:04,485 copying build/lib/lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-02-14T10:26:04,487 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-02-14T10:26:04,488 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-02-14T10:26:04,490 copying build/lib/lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-02-14T10:26:04,492 copying build/lib/lm_eval/tasks/gpqa/n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-02-14T10:26:04,494 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:26:04,495 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:26:04,497 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:26:04,499 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:26:04,500 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:26:04,502 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:26:04,504 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-02-14T10:26:04,506 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bear 2026-02-14T10:26:04,507 copying build/lib/lm_eval/tasks/bear/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bear 2026-02-14T10:26:04,509 copying build/lib/lm_eval/tasks/bear/bear_big.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bear 2026-02-14T10:26:04,511 copying build/lib/lm_eval/tasks/bear/bear.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bear 2026-02-14T10:26:04,513 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,514 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,516 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,518 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,519 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,521 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,523 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,524 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,526 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,528 copying build/lib/lm_eval/tasks/truthfulqa-multi/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,530 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,531 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,533 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,535 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,537 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,538 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,540 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,542 copying build/lib/lm_eval/tasks/truthfulqa-multi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,544 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,546 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-02-14T10:26:04,548 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/careqa 2026-02-14T10:26:04,549 copying build/lib/lm_eval/tasks/careqa/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-02-14T10:26:04,551 copying build/lib/lm_eval/tasks/careqa/careqa_open_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-02-14T10:26:04,552 copying build/lib/lm_eval/tasks/careqa/careqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-02-14T10:26:04,554 copying build/lib/lm_eval/tasks/careqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-02-14T10:26:04,556 copying build/lib/lm_eval/tasks/careqa/careqa_open.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-02-14T10:26:04,557 copying build/lib/lm_eval/tasks/careqa/utils_open.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-02-14T10:26:04,559 copying build/lib/lm_eval/tasks/careqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-02-14T10:26:04,561 copying build/lib/lm_eval/tasks/careqa/careqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-02-14T10:26:04,563 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu 2026-02-14T10:26:04,564 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate 2026-02-14T10:26:04,566 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,567 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,569 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,571 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,573 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,574 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,576 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,578 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,580 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,581 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,583 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,585 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,586 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,588 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,590 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,592 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,593 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,595 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,596 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,598 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-02-14T10:26:04,600 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2026-02-14T10:26:04,602 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,603 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,605 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,607 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,609 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,610 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,612 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,614 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,616 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,617 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,619 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,621 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,622 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,624 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,626 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,628 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,630 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,631 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,633 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,634 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-02-14T10:26:04,637 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,638 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,639 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,641 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,643 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,644 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,646 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,648 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,649 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,651 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,653 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,654 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,656 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,658 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,660 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,661 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,663 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,665 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,666 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,668 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-02-14T10:26:04,670 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,671 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,673 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,675 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,676 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,678 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,680 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,681 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,683 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,685 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,687 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,688 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,690 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,692 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,694 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,695 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,697 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,699 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,701 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,703 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-02-14T10:26:04,706 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,707 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,709 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,711 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,713 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,714 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,716 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,718 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,719 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,721 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,723 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,724 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,726 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,728 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,730 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,731 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,733 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,735 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,736 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,738 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-02-14T10:26:04,740 copying build/lib/lm_eval/tasks/afrimmlu/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-02-14T10:26:04,742 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct 2026-02-14T10:26:04,744 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,745 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,747 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,748 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,750 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,752 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,753 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,755 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,757 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,758 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,760 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,762 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,763 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,765 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,767 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,768 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,770 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,772 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,773 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,775 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,777 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-02-14T10:26:04,779 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,780 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,782 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,783 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,785 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,787 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,788 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,790 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,792 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,793 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,795 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,797 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,799 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,801 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,803 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,804 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,806 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,808 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,810 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,812 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,813 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-02-14T10:26:04,816 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,817 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,819 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,821 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,822 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,824 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,826 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,827 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,829 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,831 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,832 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,834 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,836 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,837 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,839 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,841 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,843 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,844 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,846 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,848 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,850 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-02-14T10:26:04,852 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,853 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,855 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,857 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,859 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,860 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,862 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,864 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,865 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,867 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,868 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,870 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,872 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,873 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,875 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,876 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,878 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,880 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,882 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,883 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,885 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-02-14T10:26:04,888 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,889 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,890 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,892 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,894 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,896 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,897 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,899 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,901 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,902 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,904 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,906 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,907 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,909 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,910 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,912 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,914 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,916 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,917 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,919 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,921 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-02-14T10:26:04,922 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2026-02-14T10:26:04,924 copying build/lib/lm_eval/tasks/afrimmlu/fewshot.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-02-14T10:26:04,926 copying build/lib/lm_eval/tasks/afrimmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-02-14T10:26:04,928 copying build/lib/lm_eval/tasks/afrimmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-02-14T10:26:04,929 copying build/lib/lm_eval/tasks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-02-14T10:26:04,934 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench 2026-02-14T10:26:04,935 copying build/lib/lm_eval/tasks/galician_bench/galician_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,937 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,939 copying build/lib/lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,941 copying build/lib/lm_eval/tasks/galician_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,943 copying build/lib/lm_eval/tasks/galician_bench/galcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,945 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,946 copying build/lib/lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,948 copying build/lib/lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,949 copying build/lib/lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,951 copying build/lib/lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,953 copying build/lib/lm_eval/tasks/galician_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,955 copying build/lib/lm_eval/tasks/galician_bench/paws_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,957 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,958 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,960 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,962 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,963 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,965 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,967 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,968 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,970 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,972 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,973 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,975 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,977 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,979 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,981 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,983 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,985 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,986 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,988 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,990 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-02-14T10:26:04,991 copying build/lib/lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,993 copying build/lib/lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,995 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-02-14T10:26:04,997 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/french_bench 2026-02-14T10:26:04,998 copying build/lib/lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,000 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,002 copying build/lib/lm_eval/tasks/french_bench/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,003 copying build/lib/lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,006 copying build/lib/lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,008 copying build/lib/lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,009 copying build/lib/lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,011 copying build/lib/lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,013 copying build/lib/lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,014 copying build/lib/lm_eval/tasks/french_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,017 copying build/lib/lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,019 copying build/lib/lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,020 copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,022 copying build/lib/lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,024 copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,025 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,027 copying build/lib/lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,029 copying build/lib/lm_eval/tasks/french_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,031 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,033 copying build/lib/lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,034 copying build/lib/lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,036 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-02-14T10:26:05,040 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,041 copying build/lib/lm_eval/tasks/blimp_nl/passive__aci.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,042 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,044 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,046 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,047 copying build/lib/lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,049 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,050 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,052 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,054 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,056 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,058 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,059 copying build/lib/lm_eval/tasks/blimp_nl/complementive__intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,061 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,063 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,064 copying build/lib/lm_eval/tasks/blimp_nl/relativization__island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,066 copying build/lib/lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,068 copying build/lib/lm_eval/tasks/blimp_nl/complementive__transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,070 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,071 copying build/lib/lm_eval/tasks/blimp_nl/blimp_nl_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,074 copying build/lib/lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,075 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,077 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,079 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,080 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,082 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,083 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,085 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,087 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,088 copying build/lib/lm_eval/tasks/blimp_nl/complementive__position_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,090 copying build/lib/lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,091 copying build/lib/lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,093 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,095 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,097 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,098 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,100 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,102 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,104 copying build/lib/lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,106 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,108 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,109 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,111 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,113 copying build/lib/lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,114 copying build/lib/lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,116 copying build/lib/lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,118 copying build/lib/lm_eval/tasks/blimp_nl/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,120 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,122 copying build/lib/lm_eval/tasks/blimp_nl/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,123 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,125 copying build/lib/lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,127 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,129 copying build/lib/lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,130 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,132 copying build/lib/lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,134 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,135 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,137 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,139 copying build/lib/lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,141 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,142 copying build/lib/lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,144 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,146 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,148 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,150 copying build/lib/lm_eval/tasks/blimp_nl/verb_second__order_main.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,151 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,153 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,155 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,157 copying build/lib/lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,158 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,160 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,162 copying build/lib/lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,163 copying build/lib/lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,165 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,167 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,168 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,170 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,172 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,173 copying build/lib/lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,175 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,177 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,179 copying build/lib/lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,181 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,183 copying build/lib/lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,184 copying build/lib/lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,186 copying build/lib/lm_eval/tasks/blimp_nl/passive__impersonal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,188 copying build/lib/lm_eval/tasks/blimp_nl/r_words__adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,190 copying build/lib/lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-02-14T10:26:05,193 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench 2026-02-14T10:26:05,194 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:26:05,195 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:26:05,197 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:26:05,199 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:26:05,201 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:26:05,202 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:26:05,204 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:26:05,206 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-02-14T10:26:05,208 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:26:05,209 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:26:05,211 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:26:05,213 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:26:05,214 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:26:05,216 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-02-14T10:26:05,217 copying build/lib/lm_eval/tasks/darija_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench 2026-02-14T10:26:05,220 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:26:05,221 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:26:05,223 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:26:05,225 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:26:05,226 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:26:05,228 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:26:05,230 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:26:05,232 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:26:05,233 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:26:05,235 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-02-14T10:26:05,237 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,238 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,240 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,242 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,244 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,245 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,247 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,249 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,250 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,252 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,253 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,255 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,257 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,258 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,260 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,262 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,264 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,266 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,267 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,269 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,271 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,273 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,274 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,276 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,278 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,280 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,282 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,284 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,285 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,287 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,289 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,290 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,292 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-02-14T10:26:05,294 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/groundcocoa 2026-02-14T10:26:05,295 copying build/lib/lm_eval/tasks/groundcocoa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2026-02-14T10:26:05,297 copying build/lib/lm_eval/tasks/groundcocoa/groundcocoa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2026-02-14T10:26:05,299 copying build/lib/lm_eval/tasks/groundcocoa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2026-02-14T10:26:05,302 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,303 copying build/lib/lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,305 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,306 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,308 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,310 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,312 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,314 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,315 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,317 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,319 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,321 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,323 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,325 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,327 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,328 copying build/lib/lm_eval/tasks/med_concepts_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,330 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,332 copying build/lib/lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,333 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,335 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,337 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,339 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,341 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,342 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,344 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-02-14T10:26:05,346 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/polemo2 2026-02-14T10:26:05,347 copying build/lib/lm_eval/tasks/polemo2/polemo2_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2026-02-14T10:26:05,349 copying build/lib/lm_eval/tasks/polemo2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2026-02-14T10:26:05,351 copying build/lib/lm_eval/tasks/polemo2/polemo2_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2026-02-14T10:26:05,353 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/asdiv 2026-02-14T10:26:05,354 copying build/lib/lm_eval/tasks/asdiv/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2026-02-14T10:26:05,356 copying build/lib/lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2026-02-14T10:26:05,358 copying build/lib/lm_eval/tasks/asdiv/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2026-02-14T10:26:05,361 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xwinograd 2026-02-14T10:26:05,362 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-02-14T10:26:05,364 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-02-14T10:26:05,366 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-02-14T10:26:05,368 copying build/lib/lm_eval/tasks/xwinograd/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-02-14T10:26:05,370 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-02-14T10:26:05,372 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-02-14T10:26:05,373 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-02-14T10:26:05,375 copying build/lib/lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-02-14T10:26:05,377 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-02-14T10:26:05,378 copying build/lib/lm_eval/tasks/xwinograd/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-02-14T10:26:05,381 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mathqa 2026-02-14T10:26:05,381 copying build/lib/lm_eval/tasks/mathqa/mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2026-02-14T10:26:05,383 copying build/lib/lm_eval/tasks/mathqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2026-02-14T10:26:05,385 copying build/lib/lm_eval/tasks/mathqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2026-02-14T10:26:05,388 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/longbench 2026-02-14T10:26:05,389 copying build/lib/lm_eval/tasks/longbench/repobench-p.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,391 copying build/lib/lm_eval/tasks/longbench/narrativeqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,392 copying build/lib/lm_eval/tasks/longbench/musique.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,394 copying build/lib/lm_eval/tasks/longbench/2wikimqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,396 copying build/lib/lm_eval/tasks/longbench/_longbench_multi_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,397 copying build/lib/lm_eval/tasks/longbench/vcsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,399 copying build/lib/lm_eval/tasks/longbench/lsht.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,401 copying build/lib/lm_eval/tasks/longbench/multifieldqa_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,402 copying build/lib/lm_eval/tasks/longbench/_longbench_fewshot_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,404 copying build/lib/lm_eval/tasks/longbench/_longbench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,406 copying build/lib/lm_eval/tasks/longbench/_longbench_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,408 copying build/lib/lm_eval/tasks/longbench/qmsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,410 copying build/lib/lm_eval/tasks/longbench/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,413 copying build/lib/lm_eval/tasks/longbench/_longbench_synthetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,415 copying build/lib/lm_eval/tasks/longbench/multifieldqa_en_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,417 copying build/lib/lm_eval/tasks/longbench/passage_count_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,419 copying build/lib/lm_eval/tasks/longbench/samsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,421 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,422 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,424 copying build/lib/lm_eval/tasks/longbench/multi_news_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,427 copying build/lib/lm_eval/tasks/longbench/multi_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,428 copying build/lib/lm_eval/tasks/longbench/triviaqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,430 copying build/lib/lm_eval/tasks/longbench/_longbench_code.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,432 copying build/lib/lm_eval/tasks/longbench/trec_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,433 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_en_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,435 copying build/lib/lm_eval/tasks/longbench/triviaqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,437 copying build/lib/lm_eval/tasks/longbench/hotpotqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,439 copying build/lib/lm_eval/tasks/longbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,441 copying build/lib/lm_eval/tasks/longbench/hotpotqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,442 copying build/lib/lm_eval/tasks/longbench/multifieldqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,444 copying build/lib/lm_eval/tasks/longbench/trec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,446 copying build/lib/lm_eval/tasks/longbench/repobench-p_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,448 copying build/lib/lm_eval/tasks/longbench/_longbench_single_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,449 copying build/lib/lm_eval/tasks/longbench/qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,451 copying build/lib/lm_eval/tasks/longbench/gov_report.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,453 copying build/lib/lm_eval/tasks/longbench/lcc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,454 copying build/lib/lm_eval/tasks/longbench/qasper_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,456 copying build/lib/lm_eval/tasks/longbench/_longbench_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,458 copying build/lib/lm_eval/tasks/longbench/_longbench_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,460 copying build/lib/lm_eval/tasks/longbench/dureader.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,462 copying build/lib/lm_eval/tasks/longbench/_longbench_synthetic_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,463 copying build/lib/lm_eval/tasks/longbench/_longbench_summarization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,465 copying build/lib/lm_eval/tasks/longbench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,467 copying build/lib/lm_eval/tasks/longbench/samsum_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,469 copying build/lib/lm_eval/tasks/longbench/2wikimqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,471 copying build/lib/lm_eval/tasks/longbench/_longbench_code_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,472 copying build/lib/lm_eval/tasks/longbench/_longbench_summarization_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,474 copying build/lib/lm_eval/tasks/longbench/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,476 copying build/lib/lm_eval/tasks/longbench/gov_report_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,478 copying build/lib/lm_eval/tasks/longbench/passage_count.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,480 copying build/lib/lm_eval/tasks/longbench/_longbench_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,481 copying build/lib/lm_eval/tasks/longbench/lcc_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-02-14T10:26:05,483 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals 2026-02-14T10:26:05,487 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,488 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,490 copying build/lib/lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,492 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,493 copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,495 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,497 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,499 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,500 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,502 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,504 copying build/lib/lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,506 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,507 copying build/lib/lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,509 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,511 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,512 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,514 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,516 copying build/lib/lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,518 copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,519 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,521 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,522 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,524 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,525 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,527 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,529 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,530 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,532 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,534 copying build/lib/lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,536 copying build/lib/lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,538 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,539 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,541 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,543 copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,544 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,546 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,548 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,549 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,551 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,553 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,554 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,556 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,558 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,559 copying build/lib/lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,561 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,563 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,564 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,566 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,568 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,569 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,571 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,573 copying build/lib/lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,574 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,576 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,578 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,579 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,581 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,583 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,584 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,586 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,588 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,589 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,591 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,592 copying build/lib/lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,594 copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,596 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,597 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,599 copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,601 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,602 copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,604 copying build/lib/lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,606 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,607 copying build/lib/lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,609 copying build/lib/lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,611 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,612 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,614 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,616 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,617 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,619 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,621 copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,622 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,624 copying build/lib/lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,625 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,627 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,629 copying build/lib/lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,630 copying build/lib/lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,632 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,633 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,635 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,637 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,639 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,640 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,642 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,643 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,646 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,647 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,649 copying build/lib/lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,651 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,652 copying build/lib/lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,654 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,656 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,658 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,659 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,661 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,662 copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,664 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,666 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,667 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,669 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,671 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,672 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,674 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,676 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,678 copying build/lib/lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,679 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,681 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,683 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,685 copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,686 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,688 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,689 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,691 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,692 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,694 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,696 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,697 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,699 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,701 copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,702 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,704 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,706 copying build/lib/lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,708 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,710 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,711 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,713 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,715 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,716 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-02-14T10:26:05,719 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/winogenerated 2026-02-14T10:26:05,720 copying build/lib/lm_eval/tasks/model_written_evals/winogenerated/winogenerated -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/winogenerated 2026-02-14T10:26:05,722 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/sycophancy 2026-02-14T10:26:05,723 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2026-02-14T10:26:05,725 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2026-02-14T10:26:05,727 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2026-02-14T10:26:05,729 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,730 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,732 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,734 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,736 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,737 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,739 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,741 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,742 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,744 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,746 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,748 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,749 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,751 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,753 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,754 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,756 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,758 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,759 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,761 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,763 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,764 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,766 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,767 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,769 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,771 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,772 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,774 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,776 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,778 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,779 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,781 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,782 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,784 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,786 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,788 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,789 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,791 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,792 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,794 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,795 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,797 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,799 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,801 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,802 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,804 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,806 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,808 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,809 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,811 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,813 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,814 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-02-14T10:26:05,819 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/belebele 2026-02-14T10:26:05,820 copying build/lib/lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,822 copying build/lib/lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,823 copying build/lib/lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,825 copying build/lib/lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,826 copying build/lib/lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,828 copying build/lib/lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,829 copying build/lib/lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,831 copying build/lib/lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,833 copying build/lib/lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,834 copying build/lib/lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,836 copying build/lib/lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,838 copying build/lib/lm_eval/tasks/belebele/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,839 copying build/lib/lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,841 copying build/lib/lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,842 copying build/lib/lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,844 copying build/lib/lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,846 copying build/lib/lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,847 copying build/lib/lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,849 copying build/lib/lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,851 copying build/lib/lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,852 copying build/lib/lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,854 copying build/lib/lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,856 copying build/lib/lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,857 copying build/lib/lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,859 copying build/lib/lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,861 copying build/lib/lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,862 copying build/lib/lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,864 copying build/lib/lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,866 copying build/lib/lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,867 copying build/lib/lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,869 copying build/lib/lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,871 copying build/lib/lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,872 copying build/lib/lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,874 copying build/lib/lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,875 copying build/lib/lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,877 copying build/lib/lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,879 copying build/lib/lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,880 copying build/lib/lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,882 copying build/lib/lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,883 copying build/lib/lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,885 copying build/lib/lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,887 copying build/lib/lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,888 copying build/lib/lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,890 copying build/lib/lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,892 copying build/lib/lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,893 copying build/lib/lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,895 copying build/lib/lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,897 copying build/lib/lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,898 copying build/lib/lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,900 copying build/lib/lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,902 copying build/lib/lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,903 copying build/lib/lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,905 copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,907 copying build/lib/lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,908 copying build/lib/lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,910 copying build/lib/lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,912 copying build/lib/lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,913 copying build/lib/lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,915 copying build/lib/lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,916 copying build/lib/lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,918 copying build/lib/lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,919 copying build/lib/lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,921 copying build/lib/lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,922 copying build/lib/lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,924 copying build/lib/lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,926 copying build/lib/lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,927 copying build/lib/lm_eval/tasks/belebele/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,929 copying build/lib/lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,931 copying build/lib/lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,932 copying build/lib/lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,934 copying build/lib/lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,936 copying build/lib/lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,937 copying build/lib/lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,939 copying build/lib/lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,941 copying build/lib/lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,942 copying build/lib/lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,944 copying build/lib/lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,946 copying build/lib/lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,947 copying build/lib/lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,949 copying build/lib/lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,951 copying build/lib/lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,953 copying build/lib/lm_eval/tasks/belebele/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,954 copying build/lib/lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,956 copying build/lib/lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,958 copying build/lib/lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,959 copying build/lib/lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,961 copying build/lib/lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,963 copying build/lib/lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,964 copying build/lib/lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,966 copying build/lib/lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,967 copying build/lib/lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,969 copying build/lib/lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,971 copying build/lib/lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,972 copying build/lib/lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,974 copying build/lib/lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,976 copying build/lib/lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,977 copying build/lib/lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,979 copying build/lib/lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,980 copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,982 copying build/lib/lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,984 copying build/lib/lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,986 copying build/lib/lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,988 copying build/lib/lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,990 copying build/lib/lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,991 copying build/lib/lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,993 copying build/lib/lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,995 copying build/lib/lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,996 copying build/lib/lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:05,998 copying build/lib/lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,000 copying build/lib/lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,002 copying build/lib/lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,003 copying build/lib/lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,005 copying build/lib/lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,006 copying build/lib/lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,008 copying build/lib/lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,010 copying build/lib/lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,011 copying build/lib/lm_eval/tasks/belebele/_belebele.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,013 copying build/lib/lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,014 copying build/lib/lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,016 copying build/lib/lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,018 copying build/lib/lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,019 copying build/lib/lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,021 copying build/lib/lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,022 copying build/lib/lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,024 copying build/lib/lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,026 copying build/lib/lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-02-14T10:26:06,028 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:26:06,029 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:26:06,031 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:26:06,033 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:26:06,034 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:26:06,036 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:26:06,038 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:26:06,040 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:26:06,042 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-02-14T10:26:06,044 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux 2026-02-14T10:26:06,046 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,047 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,049 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,051 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,052 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,054 copying build/lib/lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,056 copying build/lib/lm_eval/tasks/mmlu-redux/generative/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,057 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,059 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,061 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,062 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,064 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,066 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,067 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,069 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,071 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,073 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,074 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,076 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,078 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,079 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,081 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,083 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,085 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,086 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,088 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,090 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,091 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,093 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,095 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,097 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,098 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,100 copying build/lib/lm_eval/tasks/mmlu-redux/generative/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,102 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,104 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,105 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,107 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,109 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,111 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,112 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,114 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,116 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,118 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,120 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,121 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,123 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,125 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,127 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,129 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,130 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,132 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,133 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,135 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,137 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,139 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,140 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,142 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,144 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,146 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,148 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,149 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-02-14T10:26:06,152 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/olaph 2026-02-14T10:26:06,153 copying build/lib/lm_eval/tasks/olaph/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-02-14T10:26:06,154 copying build/lib/lm_eval/tasks/olaph/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-02-14T10:26:06,156 copying build/lib/lm_eval/tasks/olaph/olaph_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-02-14T10:26:06,158 copying build/lib/lm_eval/tasks/olaph/olaph.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-02-14T10:26:06,160 copying build/lib/lm_eval/tasks/olaph/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-02-14T10:26:06,162 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/discrim_eval 2026-02-14T10:26:06,163 copying build/lib/lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-02-14T10:26:06,166 copying build/lib/lm_eval/tasks/discrim_eval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-02-14T10:26:06,167 copying build/lib/lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-02-14T10:26:06,169 copying build/lib/lm_eval/tasks/discrim_eval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-02-14T10:26:06,172 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/libra 2026-02-14T10:26:06,173 copying build/lib/lm_eval/tasks/libra/ru_2wikimultihopqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,175 copying build/lib/lm_eval/tasks/libra/ru_qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,176 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,178 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,180 copying build/lib/lm_eval/tasks/libra/ru_gsm100.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,181 copying build/lib/lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,183 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,184 copying build/lib/lm_eval/tasks/libra/passkey_with_librusec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,186 copying build/lib/lm_eval/tasks/libra/matreshka_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,188 copying build/lib/lm_eval/tasks/libra/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,189 copying build/lib/lm_eval/tasks/libra/matreshka_yes_no.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,191 copying build/lib/lm_eval/tasks/libra/_simple_information_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,193 copying build/lib/lm_eval/tasks/libra/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,195 copying build/lib/lm_eval/tasks/libra/librusec_mhqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,197 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,199 copying build/lib/lm_eval/tasks/libra/librusec_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,200 copying build/lib/lm_eval/tasks/libra/passkey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,202 copying build/lib/lm_eval/tasks/libra/ru_sci_passage_count.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,204 copying build/lib/lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,206 copying build/lib/lm_eval/tasks/libra/long_context_multiq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,208 copying build/lib/lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,209 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,211 copying build/lib/lm_eval/tasks/libra/_multi_hop_question_answering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,213 copying build/lib/lm_eval/tasks/libra/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,215 copying build/lib/lm_eval/tasks/libra/ru_quality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-02-14T10:26:06,218 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmmu 2026-02-14T10:26:06,219 copying build/lib/lm_eval/tasks/mmmu/mmmu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,221 copying build/lib/lm_eval/tasks/mmmu/_art_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,222 copying build/lib/lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,224 copying build/lib/lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,226 copying build/lib/lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,228 copying build/lib/lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,229 copying build/lib/lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,231 copying build/lib/lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,232 copying build/lib/lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,234 copying build/lib/lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,236 copying build/lib/lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,237 copying build/lib/lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,239 copying build/lib/lm_eval/tasks/mmmu/_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,240 copying build/lib/lm_eval/tasks/mmmu/mmmu_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,242 copying build/lib/lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,244 copying build/lib/lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,245 copying build/lib/lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,247 copying build/lib/lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,249 copying build/lib/lm_eval/tasks/mmmu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,251 copying build/lib/lm_eval/tasks/mmmu/mmmu_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,253 copying build/lib/lm_eval/tasks/mmmu/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,254 copying build/lib/lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,256 copying build/lib/lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,258 copying build/lib/lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,260 copying build/lib/lm_eval/tasks/mmmu/_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,262 copying build/lib/lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,263 copying build/lib/lm_eval/tasks/mmmu/mmmu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,265 copying build/lib/lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,267 copying build/lib/lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,269 copying build/lib/lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,270 copying build/lib/lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,272 copying build/lib/lm_eval/tasks/mmmu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,275 copying build/lib/lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,276 copying build/lib/lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,278 copying build/lib/lm_eval/tasks/mmmu/mmmu_art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,280 copying build/lib/lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,281 copying build/lib/lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,283 copying build/lib/lm_eval/tasks/mmmu/_mmmu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,285 copying build/lib/lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,286 copying build/lib/lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-02-14T10:26:06,288 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pisa 2026-02-14T10:26:06,289 copying build/lib/lm_eval/tasks/pisa/_pisa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,291 copying build/lib/lm_eval/tasks/pisa/pisa_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,293 copying build/lib/lm_eval/tasks/pisa/pisa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,295 copying build/lib/lm_eval/tasks/pisa/pisa_en_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,297 copying build/lib/lm_eval/tasks/pisa/pisa_it_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,299 copying build/lib/lm_eval/tasks/pisa/pisa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,300 copying build/lib/lm_eval/tasks/pisa/_pisa_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,302 copying build/lib/lm_eval/tasks/pisa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,304 copying build/lib/lm_eval/tasks/pisa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,306 copying build/lib/lm_eval/tasks/pisa/pisa_fr_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,308 copying build/lib/lm_eval/tasks/pisa/pisa_es_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,309 copying build/lib/lm_eval/tasks/pisa/pisa_de_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,311 copying build/lib/lm_eval/tasks/pisa/pisa_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,313 copying build/lib/lm_eval/tasks/pisa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,315 copying build/lib/lm_eval/tasks/pisa/pisa_ch_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,317 copying build/lib/lm_eval/tasks/pisa/pisa_ch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,319 copying build/lib/lm_eval/tasks/pisa/pisa_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-02-14T10:26:06,321 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mela 2026-02-14T10:26:06,322 copying build/lib/lm_eval/tasks/mela/mela_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,324 copying build/lib/lm_eval/tasks/mela/mela_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,325 copying build/lib/lm_eval/tasks/mela/mela_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,327 copying build/lib/lm_eval/tasks/mela/mela_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,329 copying build/lib/lm_eval/tasks/mela/mela_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,330 copying build/lib/lm_eval/tasks/mela/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,332 copying build/lib/lm_eval/tasks/mela/mela_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,334 copying build/lib/lm_eval/tasks/mela/mela_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,336 copying build/lib/lm_eval/tasks/mela/mela_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,337 copying build/lib/lm_eval/tasks/mela/mela_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,339 copying build/lib/lm_eval/tasks/mela/_mela.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,341 copying build/lib/lm_eval/tasks/mela/mela_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-02-14T10:26:06,343 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/csatqa 2026-02-14T10:26:06,344 copying build/lib/lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-02-14T10:26:06,346 copying build/lib/lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-02-14T10:26:06,348 copying build/lib/lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-02-14T10:26:06,350 copying build/lib/lm_eval/tasks/csatqa/_csatqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-02-14T10:26:06,351 copying build/lib/lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-02-14T10:26:06,353 copying build/lib/lm_eval/tasks/csatqa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-02-14T10:26:06,355 copying build/lib/lm_eval/tasks/csatqa/csatqa_li.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-02-14T10:26:06,357 copying build/lib/lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-02-14T10:26:06,358 copying build/lib/lm_eval/tasks/csatqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-02-14T10:26:06,360 copying build/lib/lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-02-14T10:26:06,363 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/chartqa 2026-02-14T10:26:06,363 copying build/lib/lm_eval/tasks/chartqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-02-14T10:26:06,366 copying build/lib/lm_eval/tasks/chartqa/chartqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-02-14T10:26:06,367 copying build/lib/lm_eval/tasks/chartqa/chartqa_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-02-14T10:26:06,369 copying build/lib/lm_eval/tasks/chartqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-02-14T10:26:06,371 copying build/lib/lm_eval/tasks/chartqa/chartqa_llama_90.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-02-14T10:26:06,374 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cnn_dailymail 2026-02-14T10:26:06,375 copying build/lib/lm_eval/tasks/cnn_dailymail/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2026-02-14T10:26:06,377 copying build/lib/lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2026-02-14T10:26:06,379 copying build/lib/lm_eval/tasks/cnn_dailymail/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2026-02-14T10:26:06,382 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli 2026-02-14T10:26:06,383 copying build/lib/lm_eval/tasks/xnli/xnli_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,385 copying build/lib/lm_eval/tasks/xnli/xnli_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,387 copying build/lib/lm_eval/tasks/xnli/xnli_bg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,389 copying build/lib/lm_eval/tasks/xnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,391 copying build/lib/lm_eval/tasks/xnli/xnli_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,393 copying build/lib/lm_eval/tasks/xnli/xnli_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,395 copying build/lib/lm_eval/tasks/xnli/xnli_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,396 copying build/lib/lm_eval/tasks/xnli/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,398 copying build/lib/lm_eval/tasks/xnli/xnli_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,400 copying build/lib/lm_eval/tasks/xnli/xnli_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,402 copying build/lib/lm_eval/tasks/xnli/xnli_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,403 copying build/lib/lm_eval/tasks/xnli/_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,405 copying build/lib/lm_eval/tasks/xnli/xnli_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,407 copying build/lib/lm_eval/tasks/xnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,409 copying build/lib/lm_eval/tasks/xnli/xnli_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,411 copying build/lib/lm_eval/tasks/xnli/xnli_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,412 copying build/lib/lm_eval/tasks/xnli/xnli_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,414 copying build/lib/lm_eval/tasks/xnli/xnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,416 copying build/lib/lm_eval/tasks/xnli/xnli_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-02-14T10:26:06,418 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench 2026-02-14T10:26:06,419 copying build/lib/lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-02-14T10:26:06,425 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,426 copying build/lib/lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,428 copying build/lib/lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,429 copying build/lib/lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,431 copying build/lib/lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,433 copying build/lib/lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,435 copying build/lib/lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,437 copying build/lib/lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,438 copying build/lib/lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,440 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,442 copying build/lib/lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,444 copying build/lib/lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,446 copying build/lib/lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,447 copying build/lib/lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,449 copying build/lib/lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,451 copying build/lib/lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,453 copying build/lib/lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,455 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,457 copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,459 copying build/lib/lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,461 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,463 copying build/lib/lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,464 copying build/lib/lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,466 copying build/lib/lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,468 copying build/lib/lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,469 copying build/lib/lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,471 copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,474 copying build/lib/lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,476 copying build/lib/lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,477 copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,479 copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,481 copying build/lib/lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,483 copying build/lib/lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,484 copying build/lib/lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,486 copying build/lib/lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,488 copying build/lib/lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,490 copying build/lib/lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,491 copying build/lib/lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,493 copying build/lib/lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,494 copying build/lib/lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,496 copying build/lib/lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,498 copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,500 copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,501 copying build/lib/lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,503 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,505 copying build/lib/lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,507 copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,509 copying build/lib/lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,510 copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,512 copying build/lib/lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,514 copying build/lib/lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,516 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,517 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,519 copying build/lib/lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,521 copying build/lib/lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,523 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,524 copying build/lib/lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,526 copying build/lib/lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,528 copying build/lib/lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,529 copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,531 copying build/lib/lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,533 copying build/lib/lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,535 copying build/lib/lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,536 copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,538 copying build/lib/lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,540 copying build/lib/lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,541 copying build/lib/lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,543 copying build/lib/lm_eval/tasks/bigbench/generate_until/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,545 copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,547 copying build/lib/lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,548 copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,550 copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,552 copying build/lib/lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,554 copying build/lib/lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,555 copying build/lib/lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,557 copying build/lib/lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,559 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,561 copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,563 copying build/lib/lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,564 copying build/lib/lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,566 copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,568 copying build/lib/lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,569 copying build/lib/lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,571 copying build/lib/lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,573 copying build/lib/lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,574 copying build/lib/lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,576 copying build/lib/lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,578 copying build/lib/lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,580 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,582 copying build/lib/lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,584 copying build/lib/lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,585 copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,587 copying build/lib/lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,589 copying build/lib/lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,591 copying build/lib/lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,593 copying build/lib/lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,595 copying build/lib/lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,597 copying build/lib/lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,599 copying build/lib/lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,601 copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,603 copying build/lib/lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,605 copying build/lib/lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,607 copying build/lib/lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,608 copying build/lib/lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,610 copying build/lib/lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,612 copying build/lib/lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,614 copying build/lib/lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,616 copying build/lib/lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,617 copying build/lib/lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,619 copying build/lib/lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,836 copying build/lib/lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,838 copying build/lib/lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,839 copying build/lib/lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,841 copying build/lib/lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,843 copying build/lib/lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,845 copying build/lib/lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,846 copying build/lib/lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,848 copying build/lib/lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,850 copying build/lib/lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,852 copying build/lib/lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,854 copying build/lib/lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,856 copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,857 copying build/lib/lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,859 copying build/lib/lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,861 copying build/lib/lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,863 copying build/lib/lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,864 copying build/lib/lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,866 copying build/lib/lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,868 copying build/lib/lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,869 copying build/lib/lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,871 copying build/lib/lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,873 copying build/lib/lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,874 copying build/lib/lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,876 copying build/lib/lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,878 copying build/lib/lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,880 copying build/lib/lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,881 copying build/lib/lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,883 copying build/lib/lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,885 copying build/lib/lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,886 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,888 copying build/lib/lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,890 copying build/lib/lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,892 copying build/lib/lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,894 copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,895 copying build/lib/lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,897 copying build/lib/lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,899 copying build/lib/lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,901 copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,903 copying build/lib/lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,905 copying build/lib/lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,906 copying build/lib/lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,908 copying build/lib/lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,910 copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,911 copying build/lib/lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,913 copying build/lib/lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,915 copying build/lib/lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,917 copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,919 copying build/lib/lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,920 copying build/lib/lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,922 copying build/lib/lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,924 copying build/lib/lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,926 copying build/lib/lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,927 copying build/lib/lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,929 copying build/lib/lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,931 copying build/lib/lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,933 copying build/lib/lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,934 copying build/lib/lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,936 copying build/lib/lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-02-14T10:26:06,938 copying build/lib/lm_eval/tasks/bigbench/generate_tasks.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-02-14T10:26:06,941 copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-02-14T10:26:06,945 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,946 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,948 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,950 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,951 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,953 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,955 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,957 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,959 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,960 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,962 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,964 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,966 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,968 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,969 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,972 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,974 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,975 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,977 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,979 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,981 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,983 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,985 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,986 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,988 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,990 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,991 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,993 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,995 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,997 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:06,999 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,000 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,002 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,004 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,006 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,008 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,009 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,011 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,013 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,015 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,017 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,019 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,020 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,022 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,024 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,026 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,028 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,029 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,031 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,032 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,034 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,036 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,038 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,039 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,041 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,043 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,045 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,047 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,048 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,050 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,052 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,054 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,055 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,057 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,059 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,061 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,063 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,064 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,066 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,068 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,071 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,073 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,076 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,078 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,081 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,083 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,086 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,088 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,091 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,093 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,095 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,098 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,100 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,103 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,105 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,108 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,110 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,113 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,115 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,118 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,120 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,123 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,125 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,127 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,130 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,132 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,134 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,137 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,139 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,141 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,144 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,146 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,149 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,151 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,153 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,156 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,158 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,161 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,163 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,165 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,167 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,169 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,171 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,173 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,174 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,176 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,178 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,180 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,181 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,183 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-02-14T10:26:07,185 copying build/lib/lm_eval/tasks/bigbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-02-14T10:26:07,187 copying build/lib/lm_eval/tasks/bigbench/generate_until_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-02-14T10:26:07,189 copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-02-14T10:26:07,192 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/babilong 2026-02-14T10:26:07,193 copying build/lib/lm_eval/tasks/babilong/babilong.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,195 copying build/lib/lm_eval/tasks/babilong/babilong_longctx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,197 copying build/lib/lm_eval/tasks/babilong/babilong_qa1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,198 copying build/lib/lm_eval/tasks/babilong/babilong_qa16.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,201 copying build/lib/lm_eval/tasks/babilong/babilong_qa6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,202 copying build/lib/lm_eval/tasks/babilong/babilong_qa5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,204 copying build/lib/lm_eval/tasks/babilong/babilong_qa12.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,206 copying build/lib/lm_eval/tasks/babilong/babilong_qa20.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,208 copying build/lib/lm_eval/tasks/babilong/common_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,210 copying build/lib/lm_eval/tasks/babilong/babilong_qa8.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,212 copying build/lib/lm_eval/tasks/babilong/babilong_qa19.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,214 copying build/lib/lm_eval/tasks/babilong/babilong_qa15.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,216 copying build/lib/lm_eval/tasks/babilong/babilong_qa7.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,218 copying build/lib/lm_eval/tasks/babilong/babilong_qa18.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,220 copying build/lib/lm_eval/tasks/babilong/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,222 copying build/lib/lm_eval/tasks/babilong/babilong_qa9.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,224 copying build/lib/lm_eval/tasks/babilong/babilong_qa11.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,226 copying build/lib/lm_eval/tasks/babilong/babilong_qa17.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,228 copying build/lib/lm_eval/tasks/babilong/babilong_qa10.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,230 copying build/lib/lm_eval/tasks/babilong/babilong_qa4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,232 copying build/lib/lm_eval/tasks/babilong/babilong_qa13.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,234 copying build/lib/lm_eval/tasks/babilong/babilong_qa14.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,236 copying build/lib/lm_eval/tasks/babilong/babilong_qa3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,238 copying build/lib/lm_eval/tasks/babilong/babilong_qa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,239 copying build/lib/lm_eval/tasks/babilong/_babilong_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-02-14T10:26:07,242 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox 2026-02-14T10:26:07,244 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,246 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,248 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,249 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,251 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,253 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,255 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,257 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,258 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,260 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,262 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,264 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,266 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,268 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,270 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,272 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,273 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,275 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,277 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,279 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,281 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,282 copying build/lib/lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,284 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,286 copying build/lib/lm_eval/tasks/mmlu_prox/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,288 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,289 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,291 copying build/lib/lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,293 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,295 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,297 copying build/lib/lm_eval/tasks/mmlu_prox/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,299 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,300 copying build/lib/lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,302 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,304 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-02-14T10:26:07,307 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,308 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,309 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,311 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,313 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,315 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,317 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,319 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,321 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,322 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,324 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,326 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,327 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,329 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,331 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,333 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,334 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,336 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,338 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,340 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,342 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,343 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,345 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,347 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,349 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,351 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,352 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,354 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,356 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,358 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,360 copying build/lib/lm_eval/tasks/mmlu_prox/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,362 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,364 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,366 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-02-14T10:26:07,369 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,370 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,372 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,373 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,375 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,377 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,379 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,381 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,383 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,385 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,386 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,388 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,390 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,392 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,394 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,396 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,398 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,400 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,402 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,404 copying build/lib/lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,406 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,408 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,409 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,411 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,413 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,415 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,417 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,419 copying build/lib/lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,420 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,422 copying build/lib/lm_eval/tasks/mmlu_prox/af/_af_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,424 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,426 copying build/lib/lm_eval/tasks/mmlu_prox/af/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,428 copying build/lib/lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,430 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-02-14T10:26:07,433 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,434 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,436 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,438 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,439 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,441 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,443 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,445 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,447 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,449 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,451 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,453 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,455 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,457 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,458 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,460 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,462 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,464 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,466 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,468 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,470 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,471 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,473 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,475 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,477 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,479 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,481 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,483 copying build/lib/lm_eval/tasks/mmlu_prox/ur/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,485 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,486 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,488 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,490 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,492 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,494 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-02-14T10:26:07,497 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,498 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,501 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,503 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,505 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,507 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,509 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,511 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,513 copying build/lib/lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,515 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,517 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,519 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,521 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,523 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,525 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,527 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,529 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,530 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,532 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,534 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,536 copying build/lib/lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,538 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,540 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,542 copying build/lib/lm_eval/tasks/mmlu_prox/th/_th_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,545 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,547 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,549 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,550 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,553 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,554 copying build/lib/lm_eval/tasks/mmlu_prox/th/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,557 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,559 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,561 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,563 copying build/lib/lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-02-14T10:26:07,566 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,567 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,569 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,571 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,573 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,575 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,577 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,579 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,580 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,582 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,584 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,586 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,588 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,590 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,592 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,594 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,596 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,598 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,600 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,601 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,603 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,605 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,607 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,609 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,611 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,613 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,615 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,617 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,618 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,620 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,622 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,624 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,625 copying build/lib/lm_eval/tasks/mmlu_prox/zu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,627 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-02-14T10:26:07,630 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,631 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,633 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,634 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,636 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,638 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,640 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,642 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,644 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,646 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,647 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,649 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,651 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,653 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,655 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,657 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,659 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,661 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,662 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,664 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,666 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,667 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,669 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,671 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,673 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,674 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,676 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,678 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,680 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,681 copying build/lib/lm_eval/tasks/mmlu_prox/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,683 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,685 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,687 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,689 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-02-14T10:26:07,692 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,693 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,695 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,697 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,698 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,700 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,702 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,704 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,706 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,708 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,710 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,711 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,714 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,716 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,717 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,719 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,721 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,723 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,724 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,726 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,728 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,730 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,732 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,734 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,736 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,737 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,739 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,741 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,743 copying build/lib/lm_eval/tasks/mmlu_prox/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,745 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,747 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,749 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,751 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,752 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-02-14T10:26:07,755 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,756 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,758 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,760 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,762 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,764 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,765 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,767 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,769 copying build/lib/lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,771 copying build/lib/lm_eval/tasks/mmlu_prox/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,773 copying build/lib/lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,774 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,776 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,778 copying build/lib/lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,780 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,782 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,783 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,785 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,787 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,789 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,791 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,793 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,795 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,797 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,800 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,802 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,804 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,806 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,808 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,811 copying build/lib/lm_eval/tasks/mmlu_prox/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,812 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,814 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,816 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,818 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-02-14T10:26:07,820 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,821 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,823 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,825 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,827 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,829 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,830 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,832 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,834 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,836 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,838 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,840 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,842 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,844 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,846 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,847 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,849 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,851 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,853 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,855 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,856 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,858 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,860 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,862 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,863 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,865 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,867 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,869 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,870 copying build/lib/lm_eval/tasks/mmlu_prox/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,872 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,875 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,877 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,879 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,882 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-02-14T10:26:07,885 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/template 2026-02-14T10:26:07,886 copying build/lib/lm_eval/tasks/mmlu_prox/template/_lang_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/template 2026-02-14T10:26:07,889 copying build/lib/lm_eval/tasks/mmlu_prox/template/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/template 2026-02-14T10:26:07,893 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,894 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,897 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,900 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,902 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,904 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,907 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,909 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,912 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,914 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,916 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,918 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,921 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,923 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,925 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,928 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,930 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,932 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,935 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,937 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,939 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,942 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,944 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,952 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,954 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,957 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,959 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,961 copying build/lib/lm_eval/tasks/mmlu_prox/uk/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,964 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,966 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,969 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,971 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,973 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,975 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-02-14T10:26:07,977 copying build/lib/lm_eval/tasks/mmlu_prox/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-02-14T10:26:07,980 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:07,981 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:07,983 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:07,985 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:07,986 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:07,988 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:07,990 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:07,991 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:07,993 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:07,995 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:07,997 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:07,998 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,000 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,002 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,004 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,005 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,007 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,009 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,011 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,013 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,015 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,017 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,019 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,020 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,022 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,024 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,025 copying build/lib/lm_eval/tasks/mmlu_prox/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,027 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,029 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,030 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,032 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,034 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,035 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,037 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-02-14T10:26:08,040 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,041 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,043 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,044 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,046 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,048 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,050 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,051 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,053 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,055 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,057 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,059 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,060 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,062 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,064 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,066 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,067 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,069 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,071 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,072 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,074 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,076 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,078 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,079 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,081 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,083 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,084 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,086 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,088 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,090 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,092 copying build/lib/lm_eval/tasks/mmlu_prox/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,094 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,095 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,097 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-02-14T10:26:08,100 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,101 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,103 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,105 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,107 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,109 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,111 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,113 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,114 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,116 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,118 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,119 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,121 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,123 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,125 copying build/lib/lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,126 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,128 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,130 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,132 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,134 copying build/lib/lm_eval/tasks/mmlu_prox/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,135 copying build/lib/lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,137 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,139 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,141 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,142 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,144 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,146 copying build/lib/lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,148 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,150 copying build/lib/lm_eval/tasks/mmlu_prox/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,152 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,154 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,156 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,157 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,159 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-02-14T10:26:08,161 copying build/lib/lm_eval/tasks/mmlu_prox/lang_libs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-02-14T10:26:08,164 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,165 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,167 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,169 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,171 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,172 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,174 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,176 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,178 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,180 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,181 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,183 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,185 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,187 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,189 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,191 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,193 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,195 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,197 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,198 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,200 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,202 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,204 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,206 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,208 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,210 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,211 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,213 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,215 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,217 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,219 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,220 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,222 copying build/lib/lm_eval/tasks/mmlu_prox/hu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,224 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-02-14T10:26:08,227 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,228 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,230 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,232 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,234 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,237 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,238 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,240 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,242 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,244 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,246 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,248 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,250 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,252 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,254 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,256 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,257 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,259 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,261 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,263 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,265 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,267 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,268 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,270 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,272 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,274 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,276 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,277 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,279 copying build/lib/lm_eval/tasks/mmlu_prox/vi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,281 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,283 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,284 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,286 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,288 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-02-14T10:26:08,291 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,292 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,294 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,296 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,298 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,299 copying build/lib/lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,301 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,303 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,305 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,306 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,308 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,310 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,312 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,313 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,315 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,317 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,319 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,320 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,322 copying build/lib/lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,324 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,326 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,327 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,329 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,331 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,333 copying build/lib/lm_eval/tasks/mmlu_prox/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,334 copying build/lib/lm_eval/tasks/mmlu_prox/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,336 copying build/lib/lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,338 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,340 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,342 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,343 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,345 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,347 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,349 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-02-14T10:26:08,351 copying build/lib/lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-02-14T10:26:08,353 copying build/lib/lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-02-14T10:26:08,356 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,357 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,359 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,361 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,363 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,364 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,366 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,368 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,370 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,371 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,373 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,375 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,377 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,379 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,380 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,382 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,384 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,386 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,388 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,390 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,391 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,393 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,395 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,397 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,399 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,400 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,402 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,404 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,406 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,407 copying build/lib/lm_eval/tasks/mmlu_prox/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,409 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,411 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,413 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,414 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-02-14T10:26:08,417 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,418 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,420 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,422 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,424 copying build/lib/lm_eval/tasks/mmlu_prox/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,646 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,648 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,650 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,652 copying build/lib/lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,654 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,656 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,658 copying build/lib/lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,660 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,661 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,663 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,665 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,666 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,668 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,670 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,672 copying build/lib/lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,673 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,675 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,677 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,679 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,681 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,683 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,686 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,688 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,690 copying build/lib/lm_eval/tasks/mmlu_prox/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,693 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,695 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,697 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,700 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,702 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-02-14T10:26:08,706 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,707 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,710 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,712 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,715 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,717 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,719 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,721 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,723 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,726 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,728 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,730 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,732 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,734 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,737 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,739 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,742 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,745 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,747 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,750 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,752 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,754 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,757 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,759 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,761 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,764 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,766 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,769 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,771 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,773 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,775 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,777 copying build/lib/lm_eval/tasks/mmlu_prox/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,780 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,782 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-02-14T10:26:08,784 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,785 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,788 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,790 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,792 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,794 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,795 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,797 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,799 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,801 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,803 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,805 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,807 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,808 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,810 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,812 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,814 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,816 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,817 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,819 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,821 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,823 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,825 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,826 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,828 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,830 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,832 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,834 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,835 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,837 copying build/lib/lm_eval/tasks/mmlu_prox/cs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,839 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,841 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,843 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,844 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-02-14T10:26:08,847 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,849 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,851 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,852 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,854 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,856 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,858 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,859 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,861 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,863 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,865 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,867 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,869 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,870 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,872 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,874 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,876 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,877 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,879 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,881 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,882 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,884 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,886 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,888 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,889 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,891 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,893 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,895 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,897 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,898 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,900 copying build/lib/lm_eval/tasks/mmlu_prox/ne/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,902 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,904 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,906 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-02-14T10:26:08,909 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,910 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,912 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,913 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,916 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,917 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,919 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,921 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,923 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,924 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,926 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,928 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,930 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,932 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,934 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,936 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,938 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,940 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,942 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,943 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,945 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,947 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,949 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,951 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,952 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,954 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,956 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,958 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,960 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,962 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,964 copying build/lib/lm_eval/tasks/mmlu_prox/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,966 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,969 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,971 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-02-14T10:26:08,974 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,975 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,977 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,978 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,980 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,982 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,984 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,986 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,987 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,989 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,991 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,993 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,995 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,997 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:08,999 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,001 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,002 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,004 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,006 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,008 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,010 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,012 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,014 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,016 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,018 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,020 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,022 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,024 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,025 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,027 copying build/lib/lm_eval/tasks/mmlu_prox/sr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,029 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,031 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,033 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,035 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-02-14T10:26:09,038 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,039 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,041 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,043 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,045 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,047 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,048 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,050 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,052 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,055 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,058 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,060 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,062 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,064 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,066 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,068 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,070 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,071 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,073 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,075 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,077 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,079 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,081 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,083 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,084 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,086 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,088 copying build/lib/lm_eval/tasks/mmlu_prox/wo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,090 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,092 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,094 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,096 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,098 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,100 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,102 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-02-14T10:26:09,105 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,106 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,108 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,110 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,112 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,114 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,116 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,118 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,120 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,122 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,124 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,125 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,127 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,129 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,131 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,133 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,135 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,137 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,139 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,141 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,143 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,145 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,147 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,149 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,150 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,152 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,154 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,156 copying build/lib/lm_eval/tasks/mmlu_prox/ru/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,158 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,160 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,162 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,164 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,166 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,167 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-02-14T10:26:09,170 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,171 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,173 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,175 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,177 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,178 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,180 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,182 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,184 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,186 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,187 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,189 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,191 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,193 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,195 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,196 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,198 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,200 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,201 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,203 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,205 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,207 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,209 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,210 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,212 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,214 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,215 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,217 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,219 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,221 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,222 copying build/lib/lm_eval/tasks/mmlu_prox/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,224 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,226 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,228 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-02-14T10:26:09,231 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,232 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,233 copying build/lib/lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,235 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,237 copying build/lib/lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,239 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,241 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,243 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,244 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,246 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,248 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,250 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,252 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,254 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,256 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,257 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,259 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,261 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,263 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,265 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,267 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,268 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,270 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,272 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,274 copying build/lib/lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,276 copying build/lib/lm_eval/tasks/mmlu_prox/te/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,277 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,279 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,281 copying build/lib/lm_eval/tasks/mmlu_prox/te/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,283 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,285 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,286 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,288 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,290 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-02-14T10:26:09,293 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,294 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,296 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,297 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,299 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,301 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,303 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,304 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,306 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,308 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,310 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,312 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,313 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,315 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,317 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,319 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,321 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,323 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,325 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,327 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,328 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,330 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,332 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,334 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,336 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,338 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,340 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,341 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,343 copying build/lib/lm_eval/tasks/mmlu_prox/mr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,345 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,347 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,349 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,351 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,353 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-02-14T10:26:09,355 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus 2026-02-14T10:26:09,358 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,359 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,361 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,363 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,365 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,367 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,369 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,371 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,372 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,374 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,376 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,378 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,380 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,382 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,384 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,386 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,388 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,389 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,391 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,393 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,395 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,397 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,399 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,400 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,402 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,404 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,405 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,407 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,409 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,411 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,413 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,415 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,416 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,418 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,420 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,422 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,424 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,426 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,428 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,430 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,431 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,433 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,435 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,437 copying build/lib/lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,440 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,441 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,443 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,445 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,446 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,448 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,450 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,452 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,453 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,455 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,457 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,459 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,461 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,463 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,465 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,467 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,469 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,471 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,472 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,474 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,476 copying build/lib/lm_eval/tasks/tmmluplus/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,478 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,479 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,481 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,483 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,485 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,486 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,488 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,490 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,492 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,493 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,495 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-02-14T10:26:09,497 copying build/lib/lm_eval/tasks/tmmluplus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus 2026-02-14T10:26:09,499 copying build/lib/lm_eval/tasks/tmmluplus/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus 2026-02-14T10:26:09,503 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_exams 2026-02-14T10:26:09,504 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,506 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,508 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,510 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,511 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,513 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,515 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,517 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,519 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,521 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,523 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,525 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,526 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,529 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,530 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,532 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,534 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,535 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,537 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,539 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,540 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,542 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,544 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,546 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,548 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,550 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,552 copying build/lib/lm_eval/tasks/eus_exams/configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,553 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,555 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,557 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,559 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,561 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,563 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,564 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,566 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,568 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,570 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,572 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,574 copying build/lib/lm_eval/tasks/eus_exams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,576 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,578 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,579 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,581 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,583 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,585 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,586 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,588 copying build/lib/lm_eval/tasks/eus_exams/eus_exams -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,590 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,591 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,593 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,595 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,597 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,599 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,601 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,602 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,604 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,606 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,608 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,610 copying build/lib/lm_eval/tasks/eus_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,611 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,613 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,615 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,617 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,619 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,621 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,622 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,624 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,626 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-02-14T10:26:09,628 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm 2026-02-14T10:26:09,630 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot 2026-02-14T10:26:09,632 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,633 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,635 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,637 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,638 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,640 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,642 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,644 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,646 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,648 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,649 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,651 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,653 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,655 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,657 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,659 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,661 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,663 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,664 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,666 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-02-14T10:26:09,669 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,670 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,672 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,674 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,676 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,677 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,679 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,681 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,683 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,685 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,687 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,689 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,691 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,693 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,695 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,696 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,698 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,700 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,702 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,704 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-02-14T10:26:09,706 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot 2026-02-14T10:26:09,709 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,710 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,712 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,714 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,715 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,717 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,719 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,721 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,723 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,725 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,727 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,729 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,730 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,732 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,734 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,736 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,738 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,740 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,742 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,744 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-02-14T10:26:09,746 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,747 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,749 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,751 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,753 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,755 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,756 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,758 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,760 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,762 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,764 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,766 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,768 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,770 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,772 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,774 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,776 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,778 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,779 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,781 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-02-14T10:26:09,784 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,785 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,787 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,788 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,790 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,792 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,794 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,796 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,798 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,800 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,801 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,803 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,805 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,807 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,809 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,811 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,813 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,815 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,817 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,819 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-02-14T10:26:09,821 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate 2026-02-14T10:26:09,823 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,824 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,826 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,828 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,830 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,832 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,834 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,836 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,837 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,839 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,841 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,843 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,845 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,847 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,848 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,850 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,852 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,854 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,856 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-02-14T10:26:09,859 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,860 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,862 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,864 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,866 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,868 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,870 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,871 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,873 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,875 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,877 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,879 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,881 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,883 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,885 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,887 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,889 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,891 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,893 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-02-14T10:26:09,896 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,897 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,899 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,901 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,903 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,905 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,906 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,908 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,910 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,912 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,914 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,916 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,917 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,919 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,921 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,923 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,925 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,927 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,928 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-02-14T10:26:09,931 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,932 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,934 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,936 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,938 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,940 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,942 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,945 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,947 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,949 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,951 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,953 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,954 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,956 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,958 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,960 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,962 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,964 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,966 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-02-14T10:26:09,969 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,970 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,972 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,974 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,976 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,978 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,979 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,981 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,984 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,986 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,987 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,990 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,991 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,994 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,996 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,998 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:09,999 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:10,001 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:10,003 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-02-14T10:26:10,005 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2026-02-14T10:26:10,007 copying build/lib/lm_eval/tasks/afrimgsm/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-02-14T10:26:10,009 copying build/lib/lm_eval/tasks/afrimgsm/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-02-14T10:26:10,011 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct 2026-02-14T10:26:10,013 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,014 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,017 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,018 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,020 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,022 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,024 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,026 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,028 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,030 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,032 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,034 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,036 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,038 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,039 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,041 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,043 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,045 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,047 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,048 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,050 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-02-14T10:26:10,053 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,054 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,056 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,058 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,060 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,061 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,063 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,065 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,067 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,069 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,071 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,073 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,075 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,077 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,079 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,081 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,083 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,085 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,087 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,088 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,090 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-02-14T10:26:10,093 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,094 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,096 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,098 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,100 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,102 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,104 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,106 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,108 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,110 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,111 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,113 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,115 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,117 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,119 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,121 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,123 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,125 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,127 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,129 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,131 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-02-14T10:26:10,134 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,135 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,137 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,139 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,141 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,143 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,144 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,146 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,148 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,150 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,152 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,154 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,156 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,158 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,160 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,162 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,164 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,166 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,168 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,170 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,172 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-02-14T10:26:10,174 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,175 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,177 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,179 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,181 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,183 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,185 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,187 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,188 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,190 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,192 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,194 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,196 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,198 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,200 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,202 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,204 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,206 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,208 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,209 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,212 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-02-14T10:26:10,214 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2026-02-14T10:26:10,216 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot 2026-02-14T10:26:10,218 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,219 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,222 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,223 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,225 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,227 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,229 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,231 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,233 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,234 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,236 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,238 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,240 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,242 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,244 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,246 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,247 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,249 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,251 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,253 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,255 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-02-14T10:26:10,258 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,259 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,261 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,263 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,265 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,267 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,268 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,270 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,272 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,274 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,276 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,278 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,280 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,282 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,284 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,286 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,288 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,290 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,292 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,294 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,296 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-02-14T10:26:10,298 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,299 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,302 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,303 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,305 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,307 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,309 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,311 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,313 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,315 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,317 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,318 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,320 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,322 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,324 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,326 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,328 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,330 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,332 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,334 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,336 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-02-14T10:26:10,338 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,339 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,342 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,344 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,345 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,347 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,349 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,351 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,353 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,355 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,357 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,359 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,361 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,362 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,365 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,367 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,369 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,371 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,373 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,375 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,377 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-02-14T10:26:10,379 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot 2026-02-14T10:26:10,382 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,383 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,385 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,387 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,389 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,391 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,393 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,395 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,397 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,399 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,401 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,403 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,404 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,407 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,409 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,411 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,412 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,414 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,416 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,418 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,420 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-02-14T10:26:10,422 copying build/lib/lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-02-14T10:26:10,424 copying build/lib/lm_eval/tasks/afrimgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-02-14T10:26:10,426 copying build/lib/lm_eval/tasks/afrimgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-02-14T10:26:10,429 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/coqa 2026-02-14T10:26:10,430 copying build/lib/lm_eval/tasks/coqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2026-02-14T10:26:10,432 copying build/lib/lm_eval/tasks/coqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2026-02-14T10:26:10,435 copying build/lib/lm_eval/tasks/coqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2026-02-14T10:26:10,437 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/esbbq 2026-02-14T10:26:10,438 copying build/lib/lm_eval/tasks/esbbq/esbbq_spanish_region.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,440 copying build/lib/lm_eval/tasks/esbbq/esbbq_disability_status.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,442 copying build/lib/lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,444 copying build/lib/lm_eval/tasks/esbbq/esbbq_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,446 copying build/lib/lm_eval/tasks/esbbq/esbbq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,448 copying build/lib/lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,450 copying build/lib/lm_eval/tasks/esbbq/esbbq_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,451 copying build/lib/lm_eval/tasks/esbbq/esbbq_ses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,453 copying build/lib/lm_eval/tasks/esbbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,455 copying build/lib/lm_eval/tasks/esbbq/_esbbq_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,457 copying build/lib/lm_eval/tasks/esbbq/esbbq_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,459 copying build/lib/lm_eval/tasks/esbbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,461 copying build/lib/lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,463 copying build/lib/lm_eval/tasks/esbbq/esbbq_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-02-14T10:26:10,466 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mbpp 2026-02-14T10:26:10,467 copying build/lib/lm_eval/tasks/mbpp/mbpp_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-02-14T10:26:10,469 copying build/lib/lm_eval/tasks/mbpp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-02-14T10:26:10,471 copying build/lib/lm_eval/tasks/mbpp/mbpp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-02-14T10:26:10,473 copying build/lib/lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-02-14T10:26:10,475 copying build/lib/lm_eval/tasks/mbpp/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-02-14T10:26:10,477 copying build/lib/lm_eval/tasks/mbpp/mbpp_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-02-14T10:26:10,479 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/nq_open 2026-02-14T10:26:10,480 copying build/lib/lm_eval/tasks/nq_open/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open 2026-02-14T10:26:10,482 copying build/lib/lm_eval/tasks/nq_open/nq_open.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open 2026-02-14T10:26:10,485 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aime 2026-02-14T10:26:10,486 copying build/lib/lm_eval/tasks/aime/aime.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-02-14T10:26:10,488 copying build/lib/lm_eval/tasks/aime/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-02-14T10:26:10,490 copying build/lib/lm_eval/tasks/aime/aime25.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-02-14T10:26:10,492 copying build/lib/lm_eval/tasks/aime/aime24.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-02-14T10:26:10,494 copying build/lib/lm_eval/tasks/aime/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-02-14T10:26:10,497 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arithmetic 2026-02-14T10:26:10,498 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-02-14T10:26:10,500 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-02-14T10:26:10,502 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-02-14T10:26:10,504 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-02-14T10:26:10,506 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-02-14T10:26:10,507 copying build/lib/lm_eval/tasks/arithmetic/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-02-14T10:26:10,509 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-02-14T10:26:10,511 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-02-14T10:26:10,513 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-02-14T10:26:10,515 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-02-14T10:26:10,517 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-02-14T10:26:10,519 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noticia 2026-02-14T10:26:10,520 copying build/lib/lm_eval/tasks/noticia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2026-02-14T10:26:10,522 copying build/lib/lm_eval/tasks/noticia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2026-02-14T10:26:10,524 copying build/lib/lm_eval/tasks/noticia/noticia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2026-02-14T10:26:10,527 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openai-mmmlu 2026-02-14T10:26:10,542 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,544 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,546 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,548 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,550 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,552 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,554 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,556 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,558 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,560 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,561 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,563 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,565 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,567 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,569 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,570 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,572 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,574 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,576 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,578 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,579 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,581 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,583 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,585 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,587 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,589 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,590 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,592 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,594 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,596 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,598 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,600 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,601 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,603 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,605 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,607 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,608 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,610 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,612 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,614 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,615 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,617 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,619 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,621 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,623 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,624 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,626 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,628 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,630 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,632 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,634 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,636 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,637 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,639 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,641 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,643 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,645 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,646 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,648 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,650 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,651 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,653 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,655 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,656 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,658 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,660 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,662 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,663 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,665 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,667 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,669 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,670 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,672 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,674 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,676 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,678 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,679 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,681 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,683 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,685 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,687 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,688 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,690 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,692 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,693 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,695 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,697 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,699 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,700 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,702 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,704 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,706 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,707 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,709 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,711 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,712 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,714 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,716 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,718 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,720 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,721 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,723 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,725 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,727 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,728 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,730 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,732 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,734 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,735 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,737 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,739 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,741 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,742 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,744 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,746 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,748 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,750 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,752 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,754 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,756 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,758 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,759 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,761 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,763 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,765 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,766 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,768 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,770 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,772 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,773 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,775 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,777 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,779 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,781 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,783 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,784 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,786 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,788 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,790 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,792 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,793 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,795 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,797 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,799 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,801 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,802 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,804 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,806 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,808 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,809 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,811 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,813 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,815 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,817 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,818 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,820 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,822 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,824 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,826 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,828 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,830 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,831 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,833 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,835 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,837 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,839 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,841 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,842 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,844 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,846 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,847 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,849 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,851 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,853 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,855 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,857 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,858 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,860 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,862 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,864 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,866 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,868 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,869 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,871 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,873 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,875 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,877 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,879 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,881 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,883 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,885 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,886 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,888 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,890 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,891 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,893 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,895 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,897 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,899 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,901 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,902 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,904 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,906 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,908 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,910 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,911 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,913 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,915 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,917 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,919 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,921 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,923 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,924 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,926 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,928 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,930 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,931 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,933 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,935 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,936 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,938 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,940 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,942 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,943 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,945 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,947 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,949 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,950 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,952 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,954 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,956 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,957 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,959 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,961 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,963 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,965 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,967 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,968 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,970 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,972 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,973 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,975 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,977 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,979 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,981 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,983 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,984 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,986 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,988 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,990 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,992 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,994 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,996 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:10,998 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,000 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,001 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,003 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,005 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,007 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,009 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,010 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,012 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,014 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,016 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,017 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,019 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,021 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,023 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,025 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,027 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,029 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,030 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,032 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,034 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,036 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,038 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,039 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,041 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,043 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,045 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,046 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,048 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,050 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,052 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,053 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,055 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,057 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,059 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,061 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,063 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,065 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,066 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,068 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,070 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,072 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,074 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,076 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,078 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,080 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,082 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,084 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,086 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,087 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,089 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,091 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,092 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,094 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,096 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,098 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,100 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,102 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,104 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,106 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,108 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,109 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,111 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,113 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,115 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,117 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,119 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,121 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,123 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,124 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,126 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,128 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,130 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,131 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,133 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,135 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,137 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,139 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,141 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,143 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,145 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,147 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,149 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,151 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,152 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,154 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,156 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,158 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,160 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,162 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,164 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,166 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,168 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,169 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,171 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,173 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,175 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,177 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,179 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,180 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,182 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,184 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,187 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,189 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,191 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,193 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,195 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,197 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,199 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,201 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,202 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,204 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,206 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,208 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,210 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,212 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,214 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,216 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,217 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,219 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,221 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,223 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,225 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,227 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,228 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,230 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,232 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,234 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,236 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,238 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,239 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,241 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,243 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,245 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,247 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,248 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,250 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,252 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,253 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,255 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,257 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,258 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,260 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,262 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,264 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,266 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,268 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,270 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,272 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,274 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,276 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,277 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,279 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,281 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,283 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,285 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,287 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,289 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,291 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,293 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,295 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,297 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,299 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,300 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,302 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,304 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,306 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,308 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,310 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,312 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,314 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,316 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,317 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,319 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,321 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,323 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,325 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,327 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,329 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,331 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,333 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,335 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,337 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,339 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,341 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,343 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,344 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,346 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,348 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,350 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,352 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,354 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,356 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,358 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,360 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,362 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,364 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,366 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,368 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,370 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,372 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,374 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,376 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,378 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,379 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,381 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,383 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,385 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,387 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,389 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,391 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,393 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,395 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,396 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,398 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,400 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,402 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,404 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,406 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,408 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,410 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,411 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,413 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,415 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,417 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,419 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,421 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,423 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,425 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,427 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,429 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,430 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,432 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,434 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,436 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,438 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,440 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,442 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,444 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,446 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,448 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,449 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,451 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,453 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,456 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,458 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,460 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,462 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,463 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,465 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,467 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,469 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,471 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,473 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,475 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,477 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,479 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,480 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,482 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,484 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,486 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,488 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,490 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,492 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,494 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,496 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,498 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,500 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,502 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,504 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,506 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,508 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,510 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,512 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,514 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,516 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,517 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,519 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,521 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,523 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,525 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,527 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,529 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,530 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,532 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,535 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,537 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,539 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,541 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,543 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,545 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,547 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,549 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,551 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,553 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,555 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,557 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,559 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,561 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,562 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,564 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,566 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,568 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,570 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,572 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,574 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,576 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,578 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,580 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,582 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,584 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,586 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,588 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,590 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,591 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,593 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,595 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,597 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,599 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,601 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,602 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,604 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,606 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,608 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,610 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,612 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,614 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,615 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,617 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,619 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,621 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,623 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,624 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,626 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,628 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,630 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,632 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,633 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,635 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,637 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,639 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,641 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,643 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,644 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,646 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,648 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,650 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,652 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,654 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,657 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,659 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,662 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,664 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,666 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,669 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,671 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,673 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,675 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,677 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,679 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,681 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,683 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,685 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,687 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,689 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,691 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,694 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,696 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,698 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,700 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,702 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,704 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,706 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,708 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,710 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,712 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,714 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,717 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,718 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,721 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,723 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,725 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,728 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,730 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,733 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,735 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,737 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,739 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,741 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,743 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,745 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,747 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,749 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,751 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,753 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,755 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,757 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,759 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,761 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,763 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,765 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,767 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,769 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,771 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,773 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,775 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,777 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,779 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,781 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,783 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,785 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,787 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,789 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,791 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,793 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,795 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,797 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,799 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,801 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,803 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,805 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,808 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,810 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,812 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,814 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,816 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,818 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,820 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,821 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,823 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,825 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,827 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,829 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,831 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,833 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,835 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,837 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,840 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,842 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,844 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,846 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,848 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,850 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,852 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,854 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,856 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,858 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,860 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,861 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,863 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,865 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,867 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,869 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,871 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,873 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,875 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,877 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,879 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,881 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,883 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,885 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,887 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,889 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,891 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,893 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,895 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,897 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,899 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,901 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,903 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,905 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,907 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,909 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,911 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,913 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,915 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,917 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,918 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,920 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,922 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,924 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,926 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,928 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,930 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,932 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,934 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,936 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,938 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,940 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,942 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,944 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,946 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,948 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,950 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,952 copying build/lib/lm_eval/tasks/openai-mmmlu/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,954 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,956 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,958 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,960 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,962 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,964 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,966 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,968 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,970 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,972 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,974 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,977 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,979 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,981 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,983 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,985 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,987 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,989 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,991 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,993 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,995 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,997 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:11,999 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,001 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,003 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,006 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,008 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,009 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,011 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,013 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,015 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,017 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,019 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,021 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,023 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,025 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,027 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,029 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,031 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,033 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,035 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,037 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,039 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,041 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,043 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,045 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,047 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,049 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,051 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,053 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,055 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,057 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,059 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,061 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,063 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,065 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,068 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,070 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,072 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,074 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,075 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,077 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,079 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,081 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,083 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,085 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,087 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,089 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,091 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,093 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,095 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,097 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,099 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,101 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,103 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,105 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,107 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,109 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,111 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,113 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,115 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,117 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,120 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,122 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,124 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,126 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,128 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,130 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,132 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,134 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,136 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,138 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,140 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,142 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,144 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,146 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,148 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,150 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,152 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,154 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,157 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,159 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,161 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,163 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,165 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,167 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,169 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,171 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,173 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,175 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,177 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,179 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,181 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,183 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,185 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,187 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,189 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,191 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,193 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,197 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,198 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,200 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,202 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,204 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-02-14T10:26:12,206 copying build/lib/lm_eval/tasks/openai-mmmlu/languages.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-02-14T10:26:12,208 copying build/lib/lm_eval/tasks/openai-mmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-02-14T10:26:12,210 copying build/lib/lm_eval/tasks/openai-mmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-02-14T10:26:12,212 copying build/lib/lm_eval/tasks/openai-mmmlu/subjects.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-02-14T10:26:12,215 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kormedmcqa 2026-02-14T10:26:12,216 copying build/lib/lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-02-14T10:26:12,218 copying build/lib/lm_eval/tasks/kormedmcqa/nurse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-02-14T10:26:12,220 copying build/lib/lm_eval/tasks/kormedmcqa/pharm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-02-14T10:26:12,222 copying build/lib/lm_eval/tasks/kormedmcqa/doctor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-02-14T10:26:12,223 copying build/lib/lm_eval/tasks/kormedmcqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-02-14T10:26:12,225 copying build/lib/lm_eval/tasks/kormedmcqa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-02-14T10:26:12,227 copying build/lib/lm_eval/tasks/kormedmcqa/dentist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-02-14T10:26:12,230 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmt2016 2026-02-14T10:26:12,231 copying build/lib/lm_eval/tasks/wmt2016/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2026-02-14T10:26:12,233 copying build/lib/lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2026-02-14T10:26:12,235 copying build/lib/lm_eval/tasks/wmt2016/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2026-02-14T10:26:12,237 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fld 2026-02-14T10:26:12,238 copying build/lib/lm_eval/tasks/fld/fld_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-02-14T10:26:12,240 copying build/lib/lm_eval/tasks/fld/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-02-14T10:26:12,242 copying build/lib/lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-02-14T10:26:12,244 copying build/lib/lm_eval/tasks/fld/fld_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-02-14T10:26:12,246 copying build/lib/lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-02-14T10:26:12,248 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squad_completion 2026-02-14T10:26:12,249 copying build/lib/lm_eval/tasks/squad_completion/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2026-02-14T10:26:12,251 copying build/lib/lm_eval/tasks/squad_completion/squad_completion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2026-02-14T10:26:12,253 copying build/lib/lm_eval/tasks/squad_completion/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2026-02-14T10:26:12,256 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k 2026-02-14T10:26:12,257 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k/default 2026-02-14T10:26:12,258 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-02-14T10:26:12,261 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-02-14T10:26:12,262 copying build/lib/lm_eval/tasks/hrm8k/default/_hrm8k_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-02-14T10:26:12,264 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-02-14T10:26:12,266 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-02-14T10:26:12,268 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-02-14T10:26:12,270 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-02-14T10:26:12,272 copying build/lib/lm_eval/tasks/hrm8k/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-02-14T10:26:12,274 copying build/lib/lm_eval/tasks/hrm8k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k 2026-02-14T10:26:12,277 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k/en 2026-02-14T10:26:12,278 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-02-14T10:26:12,280 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-02-14T10:26:12,282 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-02-14T10:26:12,284 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-02-14T10:26:12,286 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-02-14T10:26:12,288 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-02-14T10:26:12,290 copying build/lib/lm_eval/tasks/hrm8k/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-02-14T10:26:12,292 copying build/lib/lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-02-14T10:26:12,295 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mlqa 2026-02-14T10:26:12,296 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,299 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,300 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,302 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,304 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,306 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,308 copying build/lib/lm_eval/tasks/mlqa/generate_tasks.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,310 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,312 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,314 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,316 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,317 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,319 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,321 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,323 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,325 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,327 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,328 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,330 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,332 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,334 copying build/lib/lm_eval/tasks/mlqa/mlqa_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,336 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,338 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,339 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,341 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,343 copying build/lib/lm_eval/tasks/mlqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,346 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,348 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,350 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,352 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,354 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,356 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,357 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,359 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,361 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,363 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,365 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,367 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,368 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,370 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,372 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,374 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,376 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,378 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,380 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,382 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,384 copying build/lib/lm_eval/tasks/mlqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,387 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,389 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,391 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,393 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,395 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,397 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-02-14T10:26:12,399 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3 2026-02-14T10:26:12,401 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct 2026-02-14T10:26:12,403 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,405 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,407 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,409 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,411 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,412 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,414 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,417 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,419 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,421 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,423 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,425 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,427 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,429 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,431 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,432 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,434 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,436 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,439 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,441 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,443 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,445 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,447 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,449 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,451 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,454 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,456 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,458 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,460 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,462 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,464 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,466 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,468 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,470 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,472 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,474 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,476 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,478 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,481 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,483 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,485 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,487 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,489 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,491 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,493 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,495 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,497 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,499 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,502 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,504 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,506 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,507 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,509 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,511 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,513 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,515 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,517 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,519 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,521 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,523 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,525 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,528 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,530 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,532 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,534 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-02-14T10:26:12,536 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/gsm8k 2026-02-14T10:26:12,537 copying build/lib/lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/gsm8k 2026-02-14T10:26:12,541 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,542 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,544 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,546 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,548 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,550 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,552 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,554 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,556 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,558 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,560 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,562 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,564 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,566 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,568 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,570 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,572 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,574 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,576 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,578 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,581 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,583 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,584 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,587 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,589 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,592 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,594 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,596 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,598 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,600 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,602 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,604 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,606 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,608 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,610 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,611 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,613 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,615 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,617 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,619 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,621 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,623 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,625 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,627 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,630 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,632 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,634 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,637 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,639 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,641 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,643 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,645 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,647 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,649 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,651 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,653 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,655 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,657 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,659 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,661 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,663 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,666 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,668 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,670 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,672 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-02-14T10:26:12,676 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,677 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,679 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,681 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,684 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,686 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,689 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,691 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,693 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,695 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,697 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,699 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,701 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,703 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,705 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,707 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,709 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,711 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,713 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,715 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,717 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,719 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,722 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,723 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,725 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,727 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,729 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,732 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,734 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,736 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,738 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,739 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,741 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,743 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,746 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,748 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,750 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,752 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,754 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,756 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,758 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,760 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,762 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,764 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,766 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,768 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,770 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,772 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,774 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,776 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,778 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,780 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,782 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,784 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,786 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,788 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,790 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,792 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,794 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,796 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,798 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,800 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,802 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,804 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,807 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-02-14T10:26:12,810 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,811 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,813 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,815 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,816 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,818 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,820 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,822 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,824 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,826 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,828 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,831 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,833 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,835 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,837 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,839 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,841 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,843 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-02-14T10:26:12,846 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,847 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,850 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,852 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,855 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,857 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,859 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,861 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,864 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,866 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,868 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,870 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,873 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,876 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,878 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,881 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,883 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,886 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,889 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,891 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,894 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,896 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,898 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,901 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,903 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,906 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,908 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,912 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,916 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,919 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,921 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,923 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,926 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,928 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,930 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,933 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,935 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,937 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,939 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,941 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,943 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,945 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,948 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,950 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,953 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,956 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,959 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,961 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,964 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,966 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,969 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,971 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,973 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,976 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,978 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,981 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,983 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,985 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,989 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,991 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,993 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,996 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:12,998 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:13,000 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:13,003 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-02-14T10:26:13,007 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,008 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,010 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,012 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,015 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,018 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,020 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,023 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,026 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,028 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,030 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,032 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,035 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,037 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,039 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,043 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,045 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,048 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,051 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,053 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,056 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,059 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,061 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,063 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,066 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,069 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,072 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,074 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,077 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,079 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,081 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,084 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,086 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,088 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,090 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,093 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,095 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,098 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,100 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,103 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,105 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,108 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,110 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,112 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,114 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,117 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,119 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,122 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,124 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,126 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,129 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,131 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,133 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,136 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,139 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,141 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,144 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,146 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,149 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,152 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,155 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,158 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,160 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,162 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,165 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-02-14T10:26:13,168 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/arc_challenge 2026-02-14T10:26:13,169 copying build/lib/lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/arc_challenge 2026-02-14T10:26:13,172 copying build/lib/lm_eval/tasks/llama3/instruct/arc_challenge/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/arc_challenge 2026-02-14T10:26:13,397 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,398 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,400 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,403 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,405 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,407 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,410 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,412 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,414 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,417 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,419 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,421 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,423 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,425 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,426 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,428 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,430 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,432 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,434 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,436 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,438 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,440 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,442 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,444 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,446 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,448 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,451 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,453 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,455 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,457 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,459 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,461 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,463 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,465 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,467 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,469 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,471 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,473 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,475 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,478 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,481 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,483 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,485 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,487 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,489 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,491 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,493 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,495 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,498 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,500 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,502 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,504 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,506 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,508 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,510 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,512 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,514 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,516 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,518 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,520 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,522 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,524 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,526 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,528 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,531 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-02-14T10:26:13,535 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,536 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,538 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,540 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,544 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,546 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,548 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,550 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,552 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,554 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,555 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,557 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,559 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,561 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,563 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,565 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,567 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,569 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,571 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,572 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,574 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,576 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,579 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,581 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,583 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,585 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,587 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,589 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,592 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,594 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,596 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,598 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,599 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,601 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,603 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,605 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,607 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,609 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,611 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,613 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,615 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,617 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,618 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,620 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,623 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,624 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,626 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,628 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,630 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,632 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,634 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,636 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,638 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,640 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,642 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,644 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,646 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,648 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,650 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,652 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,653 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,655 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,657 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,659 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-02-14T10:26:13,663 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,664 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,666 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,668 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,670 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,672 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,674 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,676 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,678 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,680 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,682 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,684 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,686 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,688 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,689 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,691 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,693 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,695 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,697 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,699 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,701 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,703 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,705 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,707 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,709 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,711 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,712 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,715 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,717 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,720 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,723 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,725 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,728 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,731 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,734 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,737 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,740 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,743 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,746 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,748 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,751 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,754 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,756 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,759 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,762 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,764 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,767 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,771 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,774 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,776 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,779 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,782 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,784 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,787 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,789 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,792 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,795 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,798 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,800 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,803 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,806 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,808 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,811 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,813 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-02-14T10:26:13,818 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,819 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,821 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,823 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,824 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,826 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,828 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,830 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,832 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,834 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,836 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,838 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,840 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,842 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,844 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,846 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,848 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,850 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,852 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,854 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,856 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,858 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,860 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,862 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,864 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,866 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,868 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,870 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,872 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,874 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,876 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,878 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,879 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,881 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,883 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,885 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,887 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,889 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,892 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,893 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,895 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,897 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,899 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,902 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,905 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,907 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,909 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,911 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,913 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,915 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,917 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,919 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,921 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,923 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,925 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,927 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,929 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,931 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,934 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,936 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,938 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,941 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,944 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,946 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,948 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-02-14T10:26:13,950 copying build/lib/lm_eval/tasks/llama3/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3 2026-02-14T10:26:13,953 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice 2026-02-14T10:26:13,955 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/piqa 2026-02-14T10:26:13,956 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-02-14T10:26:13,959 copying build/lib/lm_eval/tasks/aradice/piqa/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-02-14T10:26:13,961 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-02-14T10:26:13,963 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-02-14T10:26:13,965 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-02-14T10:26:13,967 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/openbookqa 2026-02-14T10:26:13,968 copying build/lib/lm_eval/tasks/aradice/openbookqa/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-02-14T10:26:13,970 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-02-14T10:26:13,972 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-02-14T10:26:13,974 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-02-14T10:26:13,976 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-02-14T10:26:13,978 copying build/lib/lm_eval/tasks/aradice/openbookqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-02-14T10:26:13,980 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/winogrande 2026-02-14T10:26:13,981 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-02-14T10:26:13,983 copying build/lib/lm_eval/tasks/aradice/winogrande/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-02-14T10:26:13,985 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-02-14T10:26:13,987 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-02-14T10:26:13,989 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-02-14T10:26:13,991 copying build/lib/lm_eval/tasks/aradice/winogrande/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-02-14T10:26:13,993 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:26:13,994 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:26:13,996 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:26:13,998 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:26:14,000 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:26:14,002 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:26:14,004 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:26:14,007 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:26:14,009 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-02-14T10:26:14,013 copying build/lib/lm_eval/tasks/aradice/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice 2026-02-14T10:26:14,015 copying build/lib/lm_eval/tasks/aradice/aradice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice 2026-02-14T10:26:14,018 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:26:14,019 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:26:14,022 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:26:14,024 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:26:14,029 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:26:14,030 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-02-14T10:26:14,033 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU 2026-02-14T10:26:14,036 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,037 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,039 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,042 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,044 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,046 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,048 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,049 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,051 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,053 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,054 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,056 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,059 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,061 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,062 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,064 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,066 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,068 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,069 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,071 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,073 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,075 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,077 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,079 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,081 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,082 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,084 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,086 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,088 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,090 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,092 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,094 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,096 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,097 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,099 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,101 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,103 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,105 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,107 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,109 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,111 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,113 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,115 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,117 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,119 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-02-14T10:26:14,123 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,124 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,126 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,128 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,129 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,131 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,133 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,135 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,138 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,139 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,141 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,143 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,145 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,147 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,148 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,150 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,152 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,154 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,156 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,158 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,160 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,161 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,163 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,165 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,167 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,169 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,170 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,172 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,174 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,176 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,177 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,179 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,182 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,184 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,185 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,187 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,189 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,191 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,193 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,195 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,197 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,199 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,201 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,202 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,204 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-02-14T10:26:14,207 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq 2026-02-14T10:26:14,208 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/EGY 2026-02-14T10:26:14,210 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2026-02-14T10:26:14,212 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2026-02-14T10:26:14,213 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2026-02-14T10:26:14,216 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/ENG 2026-02-14T10:26:14,217 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2026-02-14T10:26:14,219 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2026-02-14T10:26:14,221 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2026-02-14T10:26:14,223 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/LEV 2026-02-14T10:26:14,224 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2026-02-14T10:26:14,228 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2026-02-14T10:26:14,230 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2026-02-14T10:26:14,232 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/MSA 2026-02-14T10:26:14,233 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2026-02-14T10:26:14,235 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2026-02-14T10:26:14,237 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2026-02-14T10:26:14,240 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_prescriptions 2026-02-14T10:26:14,241 copying build/lib/lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2026-02-14T10:26:14,243 copying build/lib/lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2026-02-14T10:26:14,246 copying build/lib/lm_eval/tasks/med_prescriptions/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2026-02-14T10:26:14,252 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/c4 2026-02-14T10:26:14,253 copying build/lib/lm_eval/tasks/c4/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2026-02-14T10:26:14,255 copying build/lib/lm_eval/tasks/c4/preprocess_c4.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2026-02-14T10:26:14,257 copying build/lib/lm_eval/tasks/c4/c4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2026-02-14T10:26:14,260 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/truthfulqa 2026-02-14T10:26:14,261 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-02-14T10:26:14,263 copying build/lib/lm_eval/tasks/truthfulqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-02-14T10:26:14,265 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-02-14T10:26:14,267 copying build/lib/lm_eval/tasks/truthfulqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-02-14T10:26:14,269 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-02-14T10:26:14,272 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm 2026-02-14T10:26:14,274 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,275 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,277 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,279 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,280 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,282 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,284 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,286 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,288 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,290 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,291 copying build/lib/lm_eval/tasks/mgsm/direct/direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,294 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,297 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-02-14T10:26:14,299 copying build/lib/lm_eval/tasks/mgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2026-02-14T10:26:14,301 copying build/lib/lm_eval/tasks/mgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2026-02-14T10:26:14,303 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,304 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,306 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,308 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,310 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,313 copying build/lib/lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,315 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,317 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,318 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,320 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,322 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,324 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,326 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-02-14T10:26:14,327 copying build/lib/lm_eval/tasks/mgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2026-02-14T10:26:14,330 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,331 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,333 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,335 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,337 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,340 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,342 copying build/lib/lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,344 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,346 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,348 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,350 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,352 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,354 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-02-14T10:26:14,357 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu 2026-02-14T10:26:14,359 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default 2026-02-14T10:26:14,360 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:26:14,362 copying build/lib/lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:26:14,364 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:26:14,366 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:26:14,368 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:26:14,370 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:26:14,372 copying build/lib/lm_eval/tasks/global_mmlu/default/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:26:14,374 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:26:14,376 copying build/lib/lm_eval/tasks/global_mmlu/default/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:26:14,378 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-02-14T10:26:14,380 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:26:14,381 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:26:14,383 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:26:14,385 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:26:14,387 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:26:14,389 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:26:14,391 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:26:14,392 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:26:14,394 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:26:14,396 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-02-14T10:26:14,399 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:26:14,400 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:26:14,402 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:26:14,404 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:26:14,406 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:26:14,408 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:26:14,410 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:26:14,412 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:26:14,414 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:26:14,417 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-02-14T10:26:14,419 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:26:14,420 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:26:14,422 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:26:14,424 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:26:14,426 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:26:14,428 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:26:14,430 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:26:14,431 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:26:14,433 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:26:14,435 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-02-14T10:26:14,438 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:26:14,439 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:26:14,441 copying build/lib/lm_eval/tasks/global_mmlu/default/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:26:14,443 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:26:14,445 copying build/lib/lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:26:14,446 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:26:14,448 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:26:14,450 copying build/lib/lm_eval/tasks/global_mmlu/default/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:26:14,452 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:26:14,455 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-02-14T10:26:14,460 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:26:14,462 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:26:14,464 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:26:14,466 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:26:14,468 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:26:14,470 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:26:14,472 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:26:14,474 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:26:14,475 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:26:14,477 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-02-14T10:26:14,481 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:26:14,482 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:26:14,486 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:26:14,488 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:26:14,490 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:26:14,492 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:26:14,494 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:26:14,495 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:26:14,497 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:26:14,499 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-02-14T10:26:14,502 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:26:14,503 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:26:14,505 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:26:14,507 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:26:14,509 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:26:14,511 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:26:14,513 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:26:14,515 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:26:14,517 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:26:14,519 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-02-14T10:26:14,521 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:26:14,522 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:26:14,524 copying build/lib/lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:26:14,527 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:26:14,530 copying build/lib/lm_eval/tasks/global_mmlu/default/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:26:14,533 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:26:14,534 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:26:14,536 copying build/lib/lm_eval/tasks/global_mmlu/default/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:26:14,539 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:26:14,541 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-02-14T10:26:14,544 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:26:14,545 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:26:14,547 copying build/lib/lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:26:14,550 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:26:14,552 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:26:14,553 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:26:14,556 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:26:14,558 copying build/lib/lm_eval/tasks/global_mmlu/default/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:26:14,560 copying build/lib/lm_eval/tasks/global_mmlu/default/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:26:14,562 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-02-14T10:26:14,564 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:26:14,565 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:26:14,567 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:26:14,569 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:26:14,571 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:26:14,574 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:26:14,577 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:26:14,579 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:26:14,582 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:26:14,585 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-02-14T10:26:14,588 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:26:14,589 copying build/lib/lm_eval/tasks/global_mmlu/default/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:26:14,591 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:26:14,593 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:26:14,595 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:26:14,597 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:26:14,599 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:26:14,601 copying build/lib/lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:26:14,602 copying build/lib/lm_eval/tasks/global_mmlu/default/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:26:14,604 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-02-14T10:26:14,607 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:26:14,608 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:26:14,610 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:26:14,612 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:26:14,614 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:26:14,616 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:26:14,618 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:26:14,620 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:26:14,621 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:26:14,623 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-02-14T10:26:14,626 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:26:14,627 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:26:14,630 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:26:14,632 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:26:14,634 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:26:14,636 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:26:14,638 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:26:14,640 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:26:14,642 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:26:14,643 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-02-14T10:26:14,646 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:26:14,647 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:26:14,649 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:26:14,651 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:26:14,653 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:26:14,655 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:26:14,657 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:26:14,659 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:26:14,662 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:26:14,664 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-02-14T10:26:14,667 copying build/lib/lm_eval/tasks/global_mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu 2026-02-14T10:26:14,671 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full 2026-02-14T10:26:14,674 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,675 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,677 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,679 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,681 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,683 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,685 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,687 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,688 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,690 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,692 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,694 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,696 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,698 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,700 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,702 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,704 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,706 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,708 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,710 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,711 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,713 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,716 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,718 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,721 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,723 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,725 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,727 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,729 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,730 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,732 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,734 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,736 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,738 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,740 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,742 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,744 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,746 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,749 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,751 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,753 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,755 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,757 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,758 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,761 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,763 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,765 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,767 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,770 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,772 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,774 copying build/lib/lm_eval/tasks/global_mmlu/full/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,776 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,777 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,779 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,781 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,783 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,785 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,787 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,789 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,791 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,793 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,796 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,798 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,800 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,801 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-02-14T10:26:14,804 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,805 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,807 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,810 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,812 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,814 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,816 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,818 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,820 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,822 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,824 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,826 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,827 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,829 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,831 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,833 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,835 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,837 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,839 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,841 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,844 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,846 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,850 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,851 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,853 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,855 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,857 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,859 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,861 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,862 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,864 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,867 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,868 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,870 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,872 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,874 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,876 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,878 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,880 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,882 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,884 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,886 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,888 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,889 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,891 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,893 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,896 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,898 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,900 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,902 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,904 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,906 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,908 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,910 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,912 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,914 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,916 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,918 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,920 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,922 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,924 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,925 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,927 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,929 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,931 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-02-14T10:26:14,935 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,936 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,938 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,940 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,941 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,943 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,945 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,947 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,949 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,952 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,956 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,959 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,960 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,962 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,964 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,966 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,968 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,970 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,971 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,973 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,975 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,977 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,979 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,980 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,982 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,984 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,986 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,988 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,989 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,991 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,993 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,995 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,997 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:14,999 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,002 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,004 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,006 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,008 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,010 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,012 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,014 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,016 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,018 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,021 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,022 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,024 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,026 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,028 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,030 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,032 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,034 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,035 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,037 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,040 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,396 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,399 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,402 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,405 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,409 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,412 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,415 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,418 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,421 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,424 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,427 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-02-14T10:26:15,433 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,435 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,439 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_so_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,442 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,445 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,448 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,451 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,454 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,458 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,461 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,463 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,466 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,468 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,471 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,473 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,475 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,478 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,480 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,483 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,485 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,487 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,490 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,492 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,494 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,496 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,499 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,501 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,503 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,506 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,508 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,511 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,514 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,517 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,519 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,521 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,523 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,526 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,528 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,531 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,535 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,538 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,541 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,543 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,546 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,548 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,551 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,553 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,555 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,558 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,560 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,562 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,564 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,567 copying build/lib/lm_eval/tasks/global_mmlu/full/so/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,568 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,571 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,573 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,575 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,577 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,578 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,580 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,582 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,584 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,586 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,588 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,590 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-02-14T10:26:15,594 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,595 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,597 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,598 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,600 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,602 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,604 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,606 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,607 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,609 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,611 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,613 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,615 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,617 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,619 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,620 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,622 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,624 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,626 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,628 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,630 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,632 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,634 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,636 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,637 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,639 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,641 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,643 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,645 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,647 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,649 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,650 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,652 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,654 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,656 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,658 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,660 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,662 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,664 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,666 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,668 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,670 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,672 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,673 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,675 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,677 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,679 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,680 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,682 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,684 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,686 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,688 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,689 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,691 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,693 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,695 copying build/lib/lm_eval/tasks/global_mmlu/full/el/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,697 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_el_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,699 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,701 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,703 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,705 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,706 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,709 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,711 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,713 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-02-14T10:26:15,717 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,718 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,720 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,722 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,723 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,725 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,727 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,729 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,731 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,733 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,735 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,737 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,738 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,740 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,742 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,744 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,746 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,748 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,750 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,752 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,754 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,756 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,758 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,760 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,762 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,763 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,765 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,767 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,769 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,771 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,772 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,774 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,776 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,778 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,781 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,783 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,787 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,789 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,790 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,792 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,794 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,796 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,798 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,800 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,802 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,804 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,806 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,808 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,810 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,811 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,813 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,815 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,817 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,819 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,821 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,823 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,825 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,827 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,829 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,831 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,833 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,835 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,837 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,839 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,841 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-02-14T10:26:15,845 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,846 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,848 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,850 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,851 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,853 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,855 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,857 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,858 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,860 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,862 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,864 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,866 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,868 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,870 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,872 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,874 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,876 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,878 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,880 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,881 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,884 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,886 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,888 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,890 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,891 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,893 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,895 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,897 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,899 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,901 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,903 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,905 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,907 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,909 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,911 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,913 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,914 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,916 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,918 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,920 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,922 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,923 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,925 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,927 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,929 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,931 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,933 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,935 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,937 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,939 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,941 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,943 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,945 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,947 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,949 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,951 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,953 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,955 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,957 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,958 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,960 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,962 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,964 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,966 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-02-14T10:26:15,969 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,970 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,972 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,974 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,976 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,978 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,980 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,981 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,983 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,985 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,987 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,989 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,991 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,993 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,995 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,997 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:15,999 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,001 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,002 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,005 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,007 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,008 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,010 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,012 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,013 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,015 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,017 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,019 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,020 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,022 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,024 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,025 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,027 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,029 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,031 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,032 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,034 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,036 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,037 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,039 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,041 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,043 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,044 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,046 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,048 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,049 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,051 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,053 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,054 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,056 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,058 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,059 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,061 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,063 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,064 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,066 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,068 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,070 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,071 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,073 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,075 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,077 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,078 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,080 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,082 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-02-14T10:26:16,085 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,086 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,088 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,089 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,091 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,092 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,094 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,096 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,097 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,099 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,101 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,103 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,105 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,108 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,110 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,112 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,115 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,117 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,118 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,120 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,122 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,124 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,125 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,127 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,129 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,130 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,132 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,134 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,135 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,137 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,139 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,141 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,142 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,144 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,146 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,148 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,149 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,151 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,153 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,155 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,157 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,159 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,160 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,162 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,164 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,166 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,168 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,169 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,171 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,173 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,174 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,176 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,178 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,179 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,181 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,183 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,185 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,187 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,188 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,190 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,192 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,194 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,195 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,197 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,199 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-02-14T10:26:16,203 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,204 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,205 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,207 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,209 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,210 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,212 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,214 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,215 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,217 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,219 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,221 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,222 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,224 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,226 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,227 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,229 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,231 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,233 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,235 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,237 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,239 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,241 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,242 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,244 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,246 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,248 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,250 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,251 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,253 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,255 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,256 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,258 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,260 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,262 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,263 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,266 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,268 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,270 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,273 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,275 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,277 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,280 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,282 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,284 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,286 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,288 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,291 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,293 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,295 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,297 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,299 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,301 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,303 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,306 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,308 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,311 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,313 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,316 copying build/lib/lm_eval/tasks/global_mmlu/full/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,321 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,324 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,326 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,328 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,331 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,333 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-02-14T10:26:16,338 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,339 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,342 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,344 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,346 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,349 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,351 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,353 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,356 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,358 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,360 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,362 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,364 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,367 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,369 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,371 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,372 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,374 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,376 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,378 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,380 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,382 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,384 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,386 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,388 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,390 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,394 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,607 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,609 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,610 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,612 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,614 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,616 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,618 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,620 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,622 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,624 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,626 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,627 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,629 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,631 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,633 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,635 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,637 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,639 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,641 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,643 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,645 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,647 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,649 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,651 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,653 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,655 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,657 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,659 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,660 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,662 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,664 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,666 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,668 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,670 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,672 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,675 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,896 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,899 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-02-14T10:26:16,902 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,903 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,905 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,907 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,909 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,911 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,913 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,915 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,917 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,919 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,921 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,922 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,924 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,927 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,931 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,934 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,937 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,939 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,942 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,945 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,947 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,950 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,953 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,955 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,957 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,959 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,962 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,964 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,966 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,969 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,971 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,973 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,975 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,978 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,980 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,982 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,984 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,986 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,988 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,990 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,991 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,993 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,995 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,997 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:16,999 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,001 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,003 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,004 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,007 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,008 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,010 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,012 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,014 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,016 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,018 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,021 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,024 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,026 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,029 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,032 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,035 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,037 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,039 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,042 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,044 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-02-14T10:26:17,049 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,050 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,053 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,055 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,056 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,058 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,060 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,062 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,064 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,067 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,070 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,073 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,076 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,079 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,082 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,086 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,089 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,091 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,094 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_he_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,097 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,099 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,102 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,105 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,107 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,110 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,112 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,115 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,118 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,120 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,123 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,125 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,128 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,131 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,133 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,136 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,138 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,141 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,144 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,147 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,150 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,152 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,155 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,157 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,160 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,163 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,165 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,168 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,170 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,172 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,174 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,176 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,178 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,179 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,181 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,183 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,185 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,187 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,189 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,191 copying build/lib/lm_eval/tasks/global_mmlu/full/he/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,193 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,194 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,196 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,198 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,200 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,202 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-02-14T10:26:17,206 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,207 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,209 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,211 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,212 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,214 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,216 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,218 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,220 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,221 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,223 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,225 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,227 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,229 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,231 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,233 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,234 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,236 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,238 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,240 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,242 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,244 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,246 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,248 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,250 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,251 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,254 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,256 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,258 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,259 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,261 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,263 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,265 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,267 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,269 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,271 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,273 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,274 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,276 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,278 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,280 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,282 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,283 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,285 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,287 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,289 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,291 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,293 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,294 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,296 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,298 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,300 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,302 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,303 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,305 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,307 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,309 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,311 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,313 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,315 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,317 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,319 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,321 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,322 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,324 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-02-14T10:26:17,328 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,329 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,331 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,334 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,336 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,337 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,339 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,341 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,343 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,345 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,347 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,348 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,350 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,352 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,354 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,356 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,358 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,360 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,362 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,364 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,366 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,368 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,370 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,372 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,374 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,376 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,377 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,379 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,382 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,384 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,386 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,387 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,389 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,391 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,393 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,395 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,397 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,399 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,403 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,406 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,407 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,409 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,411 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,413 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,415 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,417 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,419 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,421 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,422 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,424 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,426 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,429 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,431 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,433 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,435 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,437 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,439 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,440 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,442 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,444 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,446 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,449 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,451 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,452 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,454 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-02-14T10:26:17,458 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,460 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,462 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,464 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,466 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,467 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,469 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,471 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,473 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,475 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,477 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,479 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,480 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,482 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,484 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,486 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,488 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,490 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,492 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,494 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,496 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,498 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,499 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,501 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,503 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,505 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,507 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,509 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,510 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,512 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,514 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,516 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,517 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,519 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,521 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,523 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,525 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,527 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,528 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,531 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,533 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,535 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,537 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,538 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,540 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,542 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,544 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,546 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,548 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,550 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,551 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,554 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,556 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,558 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,559 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,561 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,563 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,565 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,567 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,569 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,570 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,572 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,574 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,576 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,578 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-02-14T10:26:17,582 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,583 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,585 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,587 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,589 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,591 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,593 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,595 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,596 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,598 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,600 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,602 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,603 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,605 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,607 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,609 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,611 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,612 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,614 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,616 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,618 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,620 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,621 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,623 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,625 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,627 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,629 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,630 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,632 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,634 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,636 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,638 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,639 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,641 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,643 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,645 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,647 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,649 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,650 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,652 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,654 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,656 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,658 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,659 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,661 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,663 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,665 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,667 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,669 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,670 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,672 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,674 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,676 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,677 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,679 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,681 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,683 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,685 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,687 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,689 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,691 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,693 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,695 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,697 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,699 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-02-14T10:26:17,702 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,703 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,705 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,707 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,709 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,711 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,712 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,714 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,716 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,718 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,720 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,721 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,723 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,725 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,727 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,728 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,730 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,732 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,734 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,736 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,738 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,739 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,741 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,743 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_si_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,745 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,747 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,748 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,750 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,752 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,753 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,755 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,757 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,759 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,760 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,762 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,764 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,766 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,768 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,770 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,771 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,773 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,775 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,777 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,779 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,781 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,783 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,785 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,787 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,788 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,790 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,792 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,793 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,795 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,797 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,798 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,800 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,802 copying build/lib/lm_eval/tasks/global_mmlu/full/si/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,804 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,806 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,808 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,809 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,811 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,813 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,815 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,816 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-02-14T10:26:17,820 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,821 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,823 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,825 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,827 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,828 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,830 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,832 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,834 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,836 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,838 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,840 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,842 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,843 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,845 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,847 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,849 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,851 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,853 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,855 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,857 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,859 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,861 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,863 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,865 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,867 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,868 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,870 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,872 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,874 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,875 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,877 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,879 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,880 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,882 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,884 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,886 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,889 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,891 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,894 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,896 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,898 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,900 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,902 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,904 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,906 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,908 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,910 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,911 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,913 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,915 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,917 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,919 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,922 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,925 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,927 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,929 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,931 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,933 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,934 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,937 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,939 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,942 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,944 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,946 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-02-14T10:26:17,950 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,952 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,954 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,956 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,958 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,960 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,961 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,963 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,965 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,967 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,969 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,971 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,972 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,974 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,976 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,978 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,979 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,981 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,983 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,985 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,987 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,989 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,991 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,993 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,995 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:17,999 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,003 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,004 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,006 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,008 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,011 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,013 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,016 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,018 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,020 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,021 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,023 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,025 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,027 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,029 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,031 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,033 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,035 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,037 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,039 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,041 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,042 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,044 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,046 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,048 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,049 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,051 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,053 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,055 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,056 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,058 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,060 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,062 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,064 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,065 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,067 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,069 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,071 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,073 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,075 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-02-14T10:26:18,078 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,079 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,081 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,083 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,086 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,088 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,089 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,091 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,093 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,094 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,096 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,098 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,099 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,101 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,103 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,105 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,107 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,109 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,110 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,112 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,114 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,116 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,118 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,120 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,122 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,124 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,126 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,127 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,129 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,131 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,132 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,134 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,136 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,137 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,139 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,141 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,143 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,144 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,146 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,148 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,150 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,152 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,154 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,156 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,158 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,163 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,169 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,173 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,174 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,177 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,178 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,180 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,182 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,184 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,185 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,187 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,189 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,191 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,193 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,194 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,196 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,198 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,200 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,202 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,203 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-02-14T10:26:18,207 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,208 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,210 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_am_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,212 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,214 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,216 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,217 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,219 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,221 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,222 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,224 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,226 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,228 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,230 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,232 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,234 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,235 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,237 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,240 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,242 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,245 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,248 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,252 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,255 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,259 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,261 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,262 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,264 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,266 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,267 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,269 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,271 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,273 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,274 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,276 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,278 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,280 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,281 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,283 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,285 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,287 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,288 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,290 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,292 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,295 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,298 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,300 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,303 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,305 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,308 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,310 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,312 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,313 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,315 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,317 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,318 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,323 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,329 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,334 copying build/lib/lm_eval/tasks/global_mmlu/full/am/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,376 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,379 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,381 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,383 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,385 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,387 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-02-14T10:26:18,391 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,392 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,394 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,396 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,398 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,400 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,402 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,405 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,626 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,631 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,634 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,856 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:18,864 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,089 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,093 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,097 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,103 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,108 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,112 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,116 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,120 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,576 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,579 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,583 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,587 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,591 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,595 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,600 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,603 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,607 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,610 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,614 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,617 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,620 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,623 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,626 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,628 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,631 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,633 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,636 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,638 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,641 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,644 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,647 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,650 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,653 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,656 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,659 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,663 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,666 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,669 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,671 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,674 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,677 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,680 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,683 copying build/lib/lm_eval/tasks/global_mmlu/full/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,686 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,689 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,691 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,694 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,697 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,699 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,702 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,705 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,708 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-02-14T10:26:19,714 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,716 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,718 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,720 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,723 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,726 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,729 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,732 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,736 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,739 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,741 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,743 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,745 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,748 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,750 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,752 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,754 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,756 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,759 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,761 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,763 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,765 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,768 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,770 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,773 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,775 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,777 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,780 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,782 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,785 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,789 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,794 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,827 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,830 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,832 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,834 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,836 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,839 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,841 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,843 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,846 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,848 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,850 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,853 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,855 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,858 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,860 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,862 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,864 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,866 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,868 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,871 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,873 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,875 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,877 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,880 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,882 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,885 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,888 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,890 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,892 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,894 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,897 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,899 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,901 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-02-14T10:26:19,906 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,907 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,910 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,912 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,914 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,916 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,919 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,921 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,923 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,925 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,927 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,929 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,931 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,934 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,936 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,938 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,941 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,943 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,945 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,948 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,950 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,952 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,954 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,956 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,959 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,961 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,963 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,965 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,968 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,970 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,972 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,975 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,980 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,984 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,987 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,989 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,991 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,994 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:19,996 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,000 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,003 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,007 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,012 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,016 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,020 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,022 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,025 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,027 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,029 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,031 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,033 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,035 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,037 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,039 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,040 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,042 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,044 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,046 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,049 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,051 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,053 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,055 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,057 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,059 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,061 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-02-14T10:26:20,066 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,067 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,070 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,074 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,077 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,081 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,083 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,085 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,087 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,090 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,092 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,094 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,097 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,100 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,103 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,105 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,108 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,110 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,113 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,116 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,118 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,120 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,122 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,125 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,127 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,129 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,131 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,133 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,135 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,138 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,140 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,142 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,145 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,147 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,149 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,151 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,154 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,157 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,159 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,162 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,164 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,166 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,168 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,171 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,173 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,176 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,179 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,182 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,186 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,188 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,190 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,192 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,195 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,197 copying build/lib/lm_eval/tasks/global_mmlu/full/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,199 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,201 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,204 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,206 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,208 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,210 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,213 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,215 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,218 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,221 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,223 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-02-14T10:26:20,227 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,228 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,231 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,233 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,235 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,238 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,240 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,242 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,245 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,247 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,250 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,252 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,254 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,256 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,258 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,261 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,263 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,265 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,266 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,268 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,270 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,272 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,274 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,276 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,277 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,279 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,281 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,283 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,285 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,287 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,289 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,290 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,292 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,294 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,296 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,298 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,299 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,301 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,303 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,305 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,307 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,309 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,311 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,312 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,314 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,316 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,318 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,320 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,322 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,324 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,326 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,328 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,330 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,332 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,333 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,335 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,337 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,339 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,341 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,343 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,344 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,346 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,348 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,350 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,352 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-02-14T10:26:20,355 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,357 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,359 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,361 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,363 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,365 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,367 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,369 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,370 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,372 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,374 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,376 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,378 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,379 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,381 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,383 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,385 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,387 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,389 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,391 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,393 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,395 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,397 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,399 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,401 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,403 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,405 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,407 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,409 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,411 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,413 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,415 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,417 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,419 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,421 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,424 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,426 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,428 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,430 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,433 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,435 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,437 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,440 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,442 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,445 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,447 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,449 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,452 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,454 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,456 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,459 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,461 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,463 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,466 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,468 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,470 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,472 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,474 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,477 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,479 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,481 copying build/lib/lm_eval/tasks/global_mmlu/full/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,484 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,486 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,488 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,490 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-02-14T10:26:20,495 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,496 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,499 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,501 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,503 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,506 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,508 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,511 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,513 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,515 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,517 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,519 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,521 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,523 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,526 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,528 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,531 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,533 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,534 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,536 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,538 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,540 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,542 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,544 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,546 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,548 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,550 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,552 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,554 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,556 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,558 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,561 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,566 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,571 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,575 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,579 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,582 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,584 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,585 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,587 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,589 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,591 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,593 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,595 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,596 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,598 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,600 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,602 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,604 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,606 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,608 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,610 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,612 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,614 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,615 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,617 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,619 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,621 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,623 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,625 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,627 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,629 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,631 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,633 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,635 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-02-14T10:26:20,639 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,640 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,643 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,646 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,649 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,651 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,653 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,656 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,658 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,660 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,662 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,664 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,665 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,667 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,669 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,671 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,672 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,674 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,676 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,678 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,680 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,681 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,683 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,685 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,687 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,689 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,691 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,694 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,696 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,699 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,701 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,703 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,705 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,708 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,710 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,712 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,714 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,716 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,719 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,721 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,723 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,725 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,728 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,730 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,732 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,735 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,737 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,739 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,741 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,744 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,746 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,749 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,751 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,753 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,755 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,757 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,759 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,762 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,766 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,768 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,770 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,772 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,774 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,776 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,778 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-02-14T10:26:20,782 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,783 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,786 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,787 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,789 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,791 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,793 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,796 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,799 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,801 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,803 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,805 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,807 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,810 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,812 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,814 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,816 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,818 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,820 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,822 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,824 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,826 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,828 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,830 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,832 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,834 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,836 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,838 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,840 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,842 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,844 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,846 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,848 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,849 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,852 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,854 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,856 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,858 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,860 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,862 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,864 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,867 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,869 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,871 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,874 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,876 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,878 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,880 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,883 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,885 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,887 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,890 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,892 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,894 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,896 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,898 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,900 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,902 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,904 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,907 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,909 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,912 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,914 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,916 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,919 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-02-14T10:26:20,923 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,924 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,926 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,929 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,932 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,934 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,936 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,940 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,942 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,945 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,947 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,949 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,952 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,954 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,956 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,958 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,960 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,962 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,964 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,966 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,968 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,970 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,972 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,974 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,976 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,978 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,981 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,983 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,985 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,987 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,989 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,991 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,993 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,996 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,997 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:20,999 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,001 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,003 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,005 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,007 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,009 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,011 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,013 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,015 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,017 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,019 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,021 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,023 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,025 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,027 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,029 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,032 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,033 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,035 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,037 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,039 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,041 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,044 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,046 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,048 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,050 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,052 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,054 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,056 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,059 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-02-14T10:26:21,063 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,064 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,067 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,069 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,071 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,073 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,075 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,077 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,079 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,081 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,084 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,086 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,088 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,090 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,093 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,095 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,097 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,100 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,102 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,104 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,106 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,108 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,110 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,113 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,115 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,117 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,120 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,122 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,124 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,126 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,128 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,131 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,133 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,135 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,137 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,139 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,140 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,142 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,144 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,146 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,148 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,149 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,151 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,153 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,155 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,157 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,159 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,161 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,163 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,165 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,166 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,168 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,170 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,172 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,174 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,176 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,179 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,181 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,183 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,185 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,187 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,189 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,191 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,193 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,195 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-02-14T10:26:21,199 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,200 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,201 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,203 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,205 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,207 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,209 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,211 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,213 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,214 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,216 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,218 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,219 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,221 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,223 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,226 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,228 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,230 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,232 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,235 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,237 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,239 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,241 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,244 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,246 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,249 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,252 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,255 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,257 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,260 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,262 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,264 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,266 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,269 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,271 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,273 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,275 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,278 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,280 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,282 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,284 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,287 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,289 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,291 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,294 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,296 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,298 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,300 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,303 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,305 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,307 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,309 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,312 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,314 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,316 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,318 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,321 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,323 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,325 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,326 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,328 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,330 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,332 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,334 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,336 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-02-14T10:26:21,340 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,341 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,343 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,345 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,347 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,348 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,350 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,352 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,354 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,356 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,358 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,359 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,361 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,363 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,365 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,367 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,369 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,371 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,372 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,374 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,376 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,378 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,380 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,382 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,383 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,386 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,387 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,389 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,391 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,393 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,395 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,396 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,398 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,400 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,401 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,403 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,405 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,407 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,408 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,410 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,412 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,414 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,415 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,417 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,419 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,421 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,423 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,425 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,427 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,429 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,431 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,433 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,435 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,437 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,438 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,440 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,442 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,444 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,446 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,447 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,449 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,451 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,453 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,455 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,457 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-02-14T10:26:21,460 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,461 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,463 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,465 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,467 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,469 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,471 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,472 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,474 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,476 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,478 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,480 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,481 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,483 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,485 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,487 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,488 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,490 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,492 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,494 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,496 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,498 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,500 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,502 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,504 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,506 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,508 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,510 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,512 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,514 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,516 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,518 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,520 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,522 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,524 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,526 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,527 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,529 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,531 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,533 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,535 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,537 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,538 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,540 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,542 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,544 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,546 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,548 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,550 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,551 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,553 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,556 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,557 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,559 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,561 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,563 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,565 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,566 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,568 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,570 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,572 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,574 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,575 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,577 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,579 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-02-14T10:26:21,583 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,584 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,586 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,588 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,590 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,592 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,593 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,595 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,597 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,599 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,601 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,602 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,604 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,606 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,608 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,610 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,612 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,614 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,615 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,617 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,619 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,621 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,623 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,624 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,626 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,628 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,630 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,632 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,633 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,635 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,637 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,639 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,640 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,642 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,644 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,645 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,647 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,649 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,651 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,653 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,655 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,657 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,658 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,660 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,662 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,664 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,666 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,667 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,669 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,671 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,673 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,675 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,677 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,679 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,681 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,683 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,684 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,686 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,688 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,690 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,692 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,693 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,695 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,697 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,699 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-02-14T10:26:21,702 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,703 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,705 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,707 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,709 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,711 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,712 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,714 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,716 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,718 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,720 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,721 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,723 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,725 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,727 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,728 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,730 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,732 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,733 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,735 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,737 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,739 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,740 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,742 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,744 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,746 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,747 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,749 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,751 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,753 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,755 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,757 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,759 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,761 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,763 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,765 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,767 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,769 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,771 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,772 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,774 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,776 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,778 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,780 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,782 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,784 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,786 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,788 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,790 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,792 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,794 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,796 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,797 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,799 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,801 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,803 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,805 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,807 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,809 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,811 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,813 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,815 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,817 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,818 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,820 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-02-14T10:26:21,824 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,825 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,827 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,828 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,830 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,832 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,834 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,836 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,838 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,840 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,841 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,843 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,845 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,847 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,849 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,850 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,852 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,854 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,856 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,858 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,859 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,861 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,863 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,865 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,867 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,869 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,871 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,873 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,874 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,876 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,878 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,880 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,881 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,883 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,885 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,887 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,889 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,891 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,893 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,894 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,896 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,898 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,900 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,902 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,904 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,906 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,908 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,910 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,912 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,914 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,916 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,918 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,921 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,923 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,925 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,927 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,929 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,932 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,934 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,936 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,938 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,940 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,942 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,944 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,947 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-02-14T10:26:21,951 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,952 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,955 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,957 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,959 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,961 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,963 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,965 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,968 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,970 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,972 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,974 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,976 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,978 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,980 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,983 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,985 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,987 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,990 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,992 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,994 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,996 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:21,999 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,001 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,003 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,005 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,007 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,009 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,011 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,013 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,016 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,018 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,020 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,022 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,024 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,027 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,029 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,031 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,033 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,035 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,037 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,039 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,041 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,043 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,045 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,047 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,049 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,052 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,054 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,056 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,058 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,060 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,062 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,064 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,066 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,069 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,071 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,073 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,075 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,077 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,080 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,082 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,084 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,086 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,088 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-02-14T10:26:22,092 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,093 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,096 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,098 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,100 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,103 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,105 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,108 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,110 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,112 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,114 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,116 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,118 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,119 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,121 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,123 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,125 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,127 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,129 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,131 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,132 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,134 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,136 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,138 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,140 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,142 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,144 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,146 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,148 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,150 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,152 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,155 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,157 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,158 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,160 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,163 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,164 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,166 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,168 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,170 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,172 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,174 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,176 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,177 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,179 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,181 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,183 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,185 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,187 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,189 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,191 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,193 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,195 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,197 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,199 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,200 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,202 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,204 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,206 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,208 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,210 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,212 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,213 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,215 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,217 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-02-14T10:26:22,221 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,222 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,224 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,225 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,227 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,229 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,231 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,233 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,235 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,237 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,239 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,241 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,243 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,244 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,246 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,248 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,250 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,251 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,253 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,255 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,257 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,259 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,261 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,263 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,265 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,267 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,268 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,270 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,272 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,274 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,276 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,278 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,280 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,282 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,283 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,285 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,287 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,289 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,291 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,292 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,294 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,296 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,298 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,300 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,302 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,304 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,306 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,308 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,310 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,312 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,313 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,315 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,317 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,319 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,321 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,323 copying build/lib/lm_eval/tasks/global_mmlu/full/te/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,324 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,326 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,328 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,329 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,331 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,333 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,334 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,336 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,338 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-02-14T10:26:22,341 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu 2026-02-14T10:26:22,344 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,345 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,347 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,349 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,351 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,353 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,355 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,358 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,360 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,362 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,365 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,367 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,369 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,370 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,372 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,374 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,376 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,379 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,381 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,383 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,386 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,388 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,391 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,393 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,396 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,398 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,401 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,405 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,407 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,409 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,411 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,414 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,416 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,418 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,420 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,422 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,424 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,426 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,428 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,430 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,432 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,434 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,436 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,438 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,440 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,443 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,444 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,446 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,448 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,451 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,453 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,455 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,457 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,460 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,462 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,466 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,510 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,512 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,514 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,516 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,519 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-02-14T10:26:22,522 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,523 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,525 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,527 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,529 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,530 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,532 copying build/lib/lm_eval/tasks/mmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,534 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,536 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,538 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,539 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,542 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,545 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,547 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,549 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,551 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,553 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,555 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,557 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,560 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,562 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,564 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,566 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,568 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,570 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,572 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,574 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,576 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,578 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,582 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,584 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,586 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,588 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,590 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,592 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,593 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,595 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,597 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,599 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,601 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,603 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,604 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,606 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,608 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,610 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,612 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,614 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,616 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,618 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,619 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,621 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,623 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,625 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,627 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,629 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,632 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,637 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,642 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,647 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,651 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,653 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,658 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,877 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,880 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-02-14T10:26:22,885 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,887 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,890 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,893 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,896 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,900 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,903 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,906 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,909 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,913 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,916 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,919 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,922 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,925 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,928 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,931 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,934 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,937 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,940 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,943 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,946 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,949 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,951 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,954 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,958 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,961 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,963 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,965 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,967 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,969 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,970 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,972 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,974 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,975 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,977 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,979 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,981 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,983 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,984 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,986 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,988 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,990 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,992 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,993 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,995 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:22,997 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,000 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,002 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,004 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,006 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,008 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,010 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,011 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,013 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,015 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,017 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,018 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,020 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,022 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,023 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,025 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-02-14T10:26:23,028 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,029 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,031 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,033 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,035 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,037 copying build/lib/lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,039 copying build/lib/lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,041 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,043 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,046 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,048 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,049 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,051 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,053 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,055 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,057 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,060 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,062 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,065 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,069 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,073 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,077 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,081 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,086 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,089 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,091 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,094 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,095 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,097 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,099 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,101 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,103 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,105 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,107 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,109 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,111 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,113 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,115 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,117 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,118 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,120 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,122 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,125 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,127 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,129 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,130 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,132 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,134 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,135 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,137 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,140 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,146 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,147 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,149 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,151 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,153 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,154 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,156 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,378 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,380 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-02-14T10:26:23,386 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot 2026-02-14T10:26:23,389 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,390 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,392 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,393 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,395 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,397 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,398 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,400 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,401 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,403 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,405 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,407 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,408 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,410 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,412 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,413 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,415 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,417 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,418 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,420 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,422 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,423 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,425 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,427 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,429 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,430 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,432 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,434 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,436 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,437 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,439 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,441 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,442 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,444 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,446 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,448 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,449 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,451 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,453 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,455 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,456 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,458 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,460 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,462 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,464 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,466 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,468 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,471 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,473 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,475 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,477 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,478 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,480 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,482 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,484 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,486 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,487 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,489 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,491 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,492 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-02-14T10:26:23,496 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,497 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,499 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,500 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,502 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,504 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,506 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,508 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,509 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,511 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,513 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,515 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,516 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,518 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,520 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,522 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,523 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,525 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,527 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,529 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,530 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,532 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,534 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,535 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,537 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,539 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,541 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,543 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,544 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,546 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,548 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,550 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,551 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,553 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,555 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,557 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,559 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,561 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,563 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,564 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,566 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,568 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,570 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,571 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,573 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,575 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,576 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,578 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,580 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,582 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,583 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,585 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,587 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,589 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,591 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,593 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,594 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,596 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,598 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,600 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,602 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-02-14T10:26:23,603 copying build/lib/lm_eval/tasks/mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu 2026-02-14T10:26:23,607 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,608 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,610 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,612 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,614 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,616 copying build/lib/lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,618 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,620 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,622 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,624 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,626 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,628 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,630 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,632 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,634 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,636 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,637 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,639 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,641 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,642 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,644 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,646 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,648 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,650 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,651 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,653 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,655 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,657 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,658 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,660 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,662 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,664 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,666 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,668 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,671 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,673 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,675 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,679 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,681 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,683 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,686 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,688 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,690 copying build/lib/lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,693 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,695 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,698 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,700 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,702 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,706 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,708 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,710 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,713 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,716 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,718 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,720 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,722 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,726 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,728 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,730 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,732 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-02-14T10:26:23,735 copying build/lib/lm_eval/tasks/mmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu 2026-02-14T10:26:23,739 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/triviaqa 2026-02-14T10:26:23,741 copying build/lib/lm_eval/tasks/triviaqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa 2026-02-14T10:26:23,743 copying build/lib/lm_eval/tasks/triviaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa 2026-02-14T10:26:23,747 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux-spanish 2026-02-14T10:26:23,748 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish 2026-02-14T10:26:23,753 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,755 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,757 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,760 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,762 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,765 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,767 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,769 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,770 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,772 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,774 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,776 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,778 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,779 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,781 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,783 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,785 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,786 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,788 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,790 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,791 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,793 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,795 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,797 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,798 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,800 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,802 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,803 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,805 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,807 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,809 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,811 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,813 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,815 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,816 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,818 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,820 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,821 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,823 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,825 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,826 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,828 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,830 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,831 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,833 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,835 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,837 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,838 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,840 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,842 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,843 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,845 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,847 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,849 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,851 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,853 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,855 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,857 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,858 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,860 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-02-14T10:26:23,862 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish 2026-02-14T10:26:23,864 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xcopa 2026-02-14T10:26:23,865 copying build/lib/lm_eval/tasks/xcopa/default_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,867 copying build/lib/lm_eval/tasks/xcopa/default_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,868 copying build/lib/lm_eval/tasks/xcopa/default_et.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,870 copying build/lib/lm_eval/tasks/xcopa/default_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,872 copying build/lib/lm_eval/tasks/xcopa/default_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,873 copying build/lib/lm_eval/tasks/xcopa/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,875 copying build/lib/lm_eval/tasks/xcopa/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,877 copying build/lib/lm_eval/tasks/xcopa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,879 copying build/lib/lm_eval/tasks/xcopa/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,880 copying build/lib/lm_eval/tasks/xcopa/default_qu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,882 copying build/lib/lm_eval/tasks/xcopa/default_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,884 copying build/lib/lm_eval/tasks/xcopa/_xcopa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,885 copying build/lib/lm_eval/tasks/xcopa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,887 copying build/lib/lm_eval/tasks/xcopa/default_ht.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-02-14T10:26:23,889 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,890 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,893 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,894 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,896 copying build/lib/lm_eval/tasks/tinyBenchmarks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,898 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,900 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,902 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,904 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,905 copying build/lib/lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,907 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,909 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,910 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,912 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-02-14T10:26:23,914 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa 2026-02-14T10:26:23,915 copying build/lib/lm_eval/tasks/logiqa/utils_logiqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2026-02-14T10:26:23,917 copying build/lib/lm_eval/tasks/logiqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2026-02-14T10:26:23,919 copying build/lib/lm_eval/tasks/logiqa/logiqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2026-02-14T10:26:23,921 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/icelandic_winogrande 2026-02-14T10:26:23,922 copying build/lib/lm_eval/tasks/icelandic_winogrande/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2026-02-14T10:26:23,924 copying build/lib/lm_eval/tasks/icelandic_winogrande/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2026-02-14T10:26:23,926 copying build/lib/lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2026-02-14T10:26:23,929 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/realtoxicityprompts 2026-02-14T10:26:23,930 copying build/lib/lm_eval/tasks/realtoxicityprompts/metric.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts 2026-02-14T10:26:23,932 copying build/lib/lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts 2026-02-14T10:26:23,934 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc 2026-02-14T10:26:23,935 copying build/lib/lm_eval/tasks/arc/arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-02-14T10:26:23,937 copying build/lib/lm_eval/tasks/arc/arc_challenge_chat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-02-14T10:26:23,939 copying build/lib/lm_eval/tasks/arc/arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-02-14T10:26:23,941 copying build/lib/lm_eval/tasks/arc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-02-14T10:26:23,944 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darijammlu 2026-02-14T10:26:23,945 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,947 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,949 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,950 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,952 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,954 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,955 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,957 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,959 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_political_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,960 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,962 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,964 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,966 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,967 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,969 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,971 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,973 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,975 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,977 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,979 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,980 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,982 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,984 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,986 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,987 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,989 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,991 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,993 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,994 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,996 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:23,998 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,000 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,002 copying build/lib/lm_eval/tasks/darijammlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,004 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,006 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,008 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,009 copying build/lib/lm_eval/tasks/darijammlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,011 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,013 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,015 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,017 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,018 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,020 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,022 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,023 copying build/lib/lm_eval/tasks/darijammlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,026 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,027 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,029 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,031 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,033 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,034 copying build/lib/lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-02-14T10:26:24,037 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/histoires_morales 2026-02-14T10:26:24,038 copying build/lib/lm_eval/tasks/histoires_morales/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2026-02-14T10:26:24,040 copying build/lib/lm_eval/tasks/histoires_morales/histoires_morales.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2026-02-14T10:26:24,042 copying build/lib/lm_eval/tasks/histoires_morales/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2026-02-14T10:26:24,044 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/slr_bench 2026-02-14T10:26:24,045 copying build/lib/lm_eval/tasks/slr_bench/lm_eval_slr_bench.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-02-14T10:26:24,047 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-02-14T10:26:24,050 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-02-14T10:26:24,052 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_basic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-02-14T10:26:24,053 copying build/lib/lm_eval/tasks/slr_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-02-14T10:26:24,055 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-02-14T10:26:24,057 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-02-14T10:26:24,059 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-02-14T10:26:24,060 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-02-14T10:26:24,063 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_text_classification 2026-02-14T10:26:24,064 copying build/lib/lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2026-02-14T10:26:24,065 copying build/lib/lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2026-02-14T10:26:24,067 copying build/lib/lm_eval/tasks/med_text_classification/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2026-02-14T10:26:24,070 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks 2026-02-14T10:26:24,071 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/flan 2026-02-14T10:26:24,072 copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2026-02-14T10:26:24,074 copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2026-02-14T10:26:24,077 copying build/lib/lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2026-02-14T10:26:24,078 copying build/lib/lm_eval/tasks/benchmarks/pythia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-02-14T10:26:24,081 copying build/lib/lm_eval/tasks/benchmarks/openllm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-02-14T10:26:24,083 copying build/lib/lm_eval/tasks/benchmarks/t0_eval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-02-14T10:26:24,089 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/multimedqa 2026-02-14T10:26:24,090 copying build/lib/lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa 2026-02-14T10:26:24,092 copying build/lib/lm_eval/tasks/benchmarks/multimedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa 2026-02-14T10:26:24,094 copying build/lib/lm_eval/tasks/benchmarks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-02-14T10:26:24,096 copying build/lib/lm_eval/tasks/benchmarks/minerva_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-02-14T10:26:24,098 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_reading 2026-02-14T10:26:24,099 copying build/lib/lm_eval/tasks/eus_reading/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2026-02-14T10:26:24,101 copying build/lib/lm_eval/tasks/eus_reading/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2026-02-14T10:26:24,103 copying build/lib/lm_eval/tasks/eus_reading/eus_reading.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2026-02-14T10:26:24,106 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medmcqa 2026-02-14T10:26:24,107 copying build/lib/lm_eval/tasks/medmcqa/medmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa 2026-02-14T10:26:24,109 copying build/lib/lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa 2026-02-14T10:26:24,111 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click 2026-02-14T10:26:24,112 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,114 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_society.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,116 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,117 copying build/lib/lm_eval/tasks/click/click_cul/_click_cul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,119 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,121 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,124 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_economy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,127 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,129 copying build/lib/lm_eval/tasks/click/click_cul/_default_click_cul_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,132 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_tradition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,134 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_kpop.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,136 copying build/lib/lm_eval/tasks/click/click_cul/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-02-14T10:26:24,139 copying build/lib/lm_eval/tasks/click/click.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click 2026-02-14T10:26:24,141 copying build/lib/lm_eval/tasks/click/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click 2026-02-14T10:26:24,144 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click/click_lang 2026-02-14T10:26:24,145 copying build/lib/lm_eval/tasks/click/click_lang/_click_lang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-02-14T10:26:24,146 copying build/lib/lm_eval/tasks/click/click_lang/_default_click_lang_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-02-14T10:26:24,148 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-02-14T10:26:24,150 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-02-14T10:26:24,152 copying build/lib/lm_eval/tasks/click/click_lang/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-02-14T10:26:24,154 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_function.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-02-14T10:26:24,156 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unscramble 2026-02-14T10:26:24,157 copying build/lib/lm_eval/tasks/unscramble/reversed_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-02-14T10:26:24,161 copying build/lib/lm_eval/tasks/unscramble/random_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-02-14T10:26:24,165 copying build/lib/lm_eval/tasks/unscramble/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-02-14T10:26:24,171 copying build/lib/lm_eval/tasks/unscramble/cycle_letters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-02-14T10:26:24,177 copying build/lib/lm_eval/tasks/unscramble/anagrams1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-02-14T10:26:24,398 copying build/lib/lm_eval/tasks/unscramble/anagrams2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-02-14T10:26:24,404 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medqa 2026-02-14T10:26:24,407 copying build/lib/lm_eval/tasks/medqa/medqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa 2026-02-14T10:26:24,630 copying build/lib/lm_eval/tasks/medqa/preprocess_medqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa 2026-02-14T10:26:24,639 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paloma 2026-02-14T10:26:24,643 copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:24,867 copying build/lib/lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:24,870 copying build/lib/lm_eval/tasks/paloma/paloma_gab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:24,877 copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:24,881 copying build/lib/lm_eval/tasks/paloma/paloma_mc4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:24,885 copying build/lib/lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:24,888 copying build/lib/lm_eval/tasks/paloma/_paloma_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:24,892 copying build/lib/lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:24,895 copying build/lib/lm_eval/tasks/paloma/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:24,898 copying build/lib/lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:24,902 copying build/lib/lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:24,906 copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:25,127 copying build/lib/lm_eval/tasks/paloma/paloma_ptb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:25,132 copying build/lib/lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:25,138 copying build/lib/lm_eval/tasks/paloma/paloma_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:25,145 copying build/lib/lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:25,149 copying build/lib/lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:25,154 copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:25,157 copying build/lib/lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-02-14T10:26:25,163 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/commonsense_qa 2026-02-14T10:26:25,165 copying build/lib/lm_eval/tasks/commonsense_qa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa 2026-02-14T10:26:25,169 copying build/lib/lm_eval/tasks/commonsense_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa 2026-02-14T10:26:25,174 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darijahellaswag 2026-02-14T10:26:25,176 copying build/lib/lm_eval/tasks/darijahellaswag/darijahellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2026-02-14T10:26:25,179 copying build/lib/lm_eval/tasks/darijahellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2026-02-14T10:26:25,182 copying build/lib/lm_eval/tasks/darijahellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2026-02-14T10:26:25,188 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cabbq 2026-02-14T10:26:25,190 copying build/lib/lm_eval/tasks/cabbq/cabbq_disability_status.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,194 copying build/lib/lm_eval/tasks/cabbq/cabbq_ses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,199 copying build/lib/lm_eval/tasks/cabbq/cabbq_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,202 copying build/lib/lm_eval/tasks/cabbq/_cabbq_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,207 copying build/lib/lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,214 copying build/lib/lm_eval/tasks/cabbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,220 copying build/lib/lm_eval/tasks/cabbq/cabbq_spanish_region.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,228 copying build/lib/lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,308 copying build/lib/lm_eval/tasks/cabbq/cabbq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,311 copying build/lib/lm_eval/tasks/cabbq/cabbq_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,315 copying build/lib/lm_eval/tasks/cabbq/cabbq_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,319 copying build/lib/lm_eval/tasks/cabbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,324 copying build/lib/lm_eval/tasks/cabbq/cabbq_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,328 copying build/lib/lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-02-14T10:26:25,334 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/metabench 2026-02-14T10:26:25,336 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,342 copying build/lib/lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,346 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,349 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,352 copying build/lib/lm_eval/tasks/metabench/process_docs_permute.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,356 copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,358 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,361 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,363 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,367 copying build/lib/lm_eval/tasks/metabench/metabench_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,369 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,372 copying build/lib/lm_eval/tasks/metabench/metabench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,374 copying build/lib/lm_eval/tasks/metabench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,377 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,380 copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,382 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,385 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,388 copying build/lib/lm_eval/tasks/metabench/metabench_arc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,390 copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,393 copying build/lib/lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,396 copying build/lib/lm_eval/tasks/metabench/process_docs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,399 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,403 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,407 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,411 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,415 copying build/lib/lm_eval/tasks/metabench/metabench_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,419 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,424 copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,427 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-02-14T10:26:25,431 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile_10k 2026-02-14T10:26:25,433 copying build/lib/lm_eval/tasks/pile_10k/pile_10k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k 2026-02-14T10:26:25,436 copying build/lib/lm_eval/tasks/pile_10k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k 2026-02-14T10:26:25,441 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/minerva_math 2026-02-14T10:26:25,444 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-02-14T10:26:25,449 copying build/lib/lm_eval/tasks/minerva_math/minerva_math500.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-02-14T10:26:25,454 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-02-14T10:26:25,459 copying build/lib/lm_eval/tasks/minerva_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-02-14T10:26:25,464 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-02-14T10:26:25,468 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-02-14T10:26:25,471 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-02-14T10:26:25,473 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-02-14T10:26:25,476 copying build/lib/lm_eval/tasks/minerva_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-02-14T10:26:25,480 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-02-14T10:26:25,484 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bertaqa 2026-02-14T10:26:25,487 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,491 copying build/lib/lm_eval/tasks/bertaqa/_bertaqa_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,495 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,499 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,718 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,722 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,727 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,733 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,738 copying build/lib/lm_eval/tasks/bertaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,743 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,749 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,968 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,972 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,975 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,979 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,983 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,986 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,989 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-02-14T10:26:25,994 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval 2026-02-14T10:26:25,995 copying build/lib/lm_eval/tasks/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-02-14T10:26:25,999 copying build/lib/lm_eval/tasks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-02-14T10:26:26,004 copying build/lib/lm_eval/tasks/ifeval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-02-14T10:26:26,007 copying build/lib/lm_eval/tasks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-02-14T10:26:26,014 copying build/lib/lm_eval/tasks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-02-14T10:26:26,017 copying build/lib/lm_eval/tasks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-02-14T10:26:26,021 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval/multilingual 2026-02-14T10:26:26,023 copying build/lib/lm_eval/tasks/ifeval/multilingual/ifeval_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-02-14T10:26:26,026 copying build/lib/lm_eval/tasks/ifeval/multilingual/ifeval_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-02-14T10:26:26,030 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval/multilingual/instructions 2026-02-14T10:26:26,031 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions/ca_instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instructions 2026-02-14T10:26:26,037 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions/es_instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instructions 2026-02-14T10:26:26,044 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instructions 2026-02-14T10:26:26,046 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-02-14T10:26:26,050 copying build/lib/lm_eval/tasks/ifeval/multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-02-14T10:26:26,054 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-02-14T10:26:26,056 copying build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils/es_instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-02-14T10:26:26,061 copying build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-02-14T10:26:26,065 copying build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils/ca_instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-02-14T10:26:26,289 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mc_taco 2026-02-14T10:26:26,291 copying build/lib/lm_eval/tasks/mc_taco/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco 2026-02-14T10:26:26,296 copying build/lib/lm_eval/tasks/mc_taco/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco 2026-02-14T10:26:26,300 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,302 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,306 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,309 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,312 copying build/lib/lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,316 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,319 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,322 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,325 copying build/lib/lm_eval/tasks/japanese_leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,329 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,332 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,334 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,337 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,340 copying build/lib/lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,343 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,347 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-02-14T10:26:26,351 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,352 copying build/lib/lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,356 copying build/lib/lm_eval/tasks/xstorycloze/default_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,359 copying build/lib/lm_eval/tasks/xstorycloze/default_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,362 copying build/lib/lm_eval/tasks/xstorycloze/default_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,365 copying build/lib/lm_eval/tasks/xstorycloze/default_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,368 copying build/lib/lm_eval/tasks/xstorycloze/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,371 copying build/lib/lm_eval/tasks/xstorycloze/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,374 copying build/lib/lm_eval/tasks/xstorycloze/default_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,377 copying build/lib/lm_eval/tasks/xstorycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,380 copying build/lib/lm_eval/tasks/xstorycloze/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,383 copying build/lib/lm_eval/tasks/xstorycloze/default_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,386 copying build/lib/lm_eval/tasks/xstorycloze/default_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,389 copying build/lib/lm_eval/tasks/xstorycloze/default_my.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-02-14T10:26:26,393 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/scrolls 2026-02-14T10:26:26,394 copying build/lib/lm_eval/tasks/scrolls/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-02-14T10:26:26,398 copying build/lib/lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-02-14T10:26:26,401 copying build/lib/lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-02-14T10:26:26,404 copying build/lib/lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-02-14T10:26:26,407 copying build/lib/lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-02-14T10:26:26,409 copying build/lib/lm_eval/tasks/scrolls/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-02-14T10:26:26,412 copying build/lib/lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-02-14T10:26:26,414 copying build/lib/lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-02-14T10:26:26,416 copying build/lib/lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-02-14T10:26:26,419 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench 2026-02-14T10:26:26,421 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti 2026-02-14T10:26:26,422 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:26:26,424 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:26:26,426 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:26:26,427 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:26:26,429 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:26:26,431 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:26:26,433 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:26:26,435 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-02-14T10:26:26,437 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:26:26,438 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:26:26,440 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:26:26,442 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:26:26,444 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:26:26,446 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:26:26,447 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:26:26,449 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-02-14T10:26:26,452 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:26:26,453 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:26:26,455 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:26:26,457 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:26:26,458 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:26:26,460 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:26:26,462 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:26:26,464 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-02-14T10:26:26,466 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:26:26,467 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:26:26,469 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:26:26,471 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:26:26,473 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:26:26,474 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:26:26,476 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:26:26,478 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-02-14T10:26:26,480 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:26:26,481 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:26:26,484 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:26:26,485 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:26:26,487 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:26:26,489 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:26:26,491 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:26:26,493 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-02-14T10:26:26,494 copying build/lib/lm_eval/tasks/afrobench/nollysenti/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti 2026-02-14T10:26:26,496 copying build/lib/lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti 2026-02-14T10:26:26,498 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews 2026-02-14T10:26:26,500 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,501 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,503 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,505 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,507 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,508 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,510 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,512 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,514 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,516 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,518 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,520 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,522 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,523 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,525 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,527 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,529 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,531 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,533 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-02-14T10:26:26,536 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,537 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,539 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,541 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,542 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,544 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,546 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,548 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,550 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,552 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,554 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,556 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,558 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,560 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,562 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,564 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,566 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,568 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,570 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-02-14T10:26:26,572 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,573 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,576 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,578 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,580 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,581 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,583 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,585 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,587 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,589 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,591 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,592 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,594 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,596 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,598 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,600 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,602 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,604 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,606 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-02-14T10:26:26,608 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,609 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,612 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,613 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,615 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,617 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,619 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,621 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,623 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,625 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,627 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,628 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,630 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,632 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,634 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,636 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,638 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,640 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,642 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-02-14T10:26:26,644 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,645 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,647 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,649 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,651 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,653 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,655 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,657 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,659 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,661 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,663 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,665 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,666 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,668 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,670 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,672 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,674 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,676 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,678 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-02-14T10:26:26,679 copying build/lib/lm_eval/tasks/afrobench/masakhanews/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2026-02-14T10:26:26,682 copying build/lib/lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2026-02-14T10:26:26,684 copying build/lib/lm_eval/tasks/afrobench/masakhanews/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2026-02-14T10:26:26,687 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy 2026-02-14T10:26:26,689 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:26:26,690 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:26:26,693 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:26:26,694 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:26:26,696 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:26:26,698 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:26:26,700 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:26:26,702 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:26:26,705 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:26:26,707 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-02-14T10:26:26,709 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:26:26,710 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:26:26,712 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:26:26,714 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:26:26,716 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:26:26,718 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:26:26,719 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:26:26,721 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:26:26,723 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:26:26,725 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-02-14T10:26:26,728 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:26:26,729 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:26:26,731 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:26:26,733 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:26:26,735 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:26:26,737 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:26:26,739 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:26:26,741 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:26:26,743 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:26:26,745 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-02-14T10:26:26,748 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:26:26,749 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:26:26,751 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:26:26,753 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:26:26,755 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:26:26,757 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:26:26,759 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:26:26,761 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:26:26,762 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:26:26,764 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-02-14T10:26:26,767 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:26:26,768 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:26:26,770 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:26:26,772 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:26:26,774 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:26:26,776 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:26:26,778 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:26:26,780 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:26:26,782 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:26:26,784 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-02-14T10:26:26,786 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2026-02-14T10:26:26,788 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2026-02-14T10:26:26,790 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2026-02-14T10:26:26,794 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu 2026-02-14T10:26:26,795 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2026-02-14T10:26:26,797 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-02-14T10:26:26,798 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-02-14T10:26:26,800 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-02-14T10:26:26,802 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-02-14T10:26:26,804 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-02-14T10:26:26,806 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-02-14T10:26:26,807 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-02-14T10:26:26,809 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-02-14T10:26:26,811 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-02-14T10:26:26,813 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-02-14T10:26:26,815 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-02-14T10:26:26,816 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-02-14T10:26:26,818 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-02-14T10:26:26,820 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-02-14T10:26:26,822 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-02-14T10:26:26,824 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-02-14T10:26:26,825 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-02-14T10:26:26,827 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-02-14T10:26:26,829 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-02-14T10:26:26,831 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-02-14T10:26:26,833 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-02-14T10:26:26,834 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-02-14T10:26:26,836 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-02-14T10:26:26,838 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-02-14T10:26:26,839 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-02-14T10:26:26,841 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2026-02-14T10:26:26,843 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2026-02-14T10:26:26,845 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr 2026-02-14T10:26:26,846 copying build/lib/lm_eval/tasks/afrobench/adr/afridiacritics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2026-02-14T10:26:26,849 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:26:26,850 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:26:26,852 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:26:26,854 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:26:26,856 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:26:26,857 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:26:26,859 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-02-14T10:26:26,862 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:26:26,863 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:26:26,865 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:26:26,867 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:26:26,869 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:26:26,871 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:26:26,873 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-02-14T10:26:26,875 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:26:26,876 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:26:26,879 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:26:26,881 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:26:26,883 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:26:26,884 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:26:26,886 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-02-14T10:26:26,888 copying build/lib/lm_eval/tasks/afrobench/adr/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2026-02-14T10:26:26,891 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:26:26,892 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:26:26,894 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:26:26,896 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:26:26,897 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:26:26,899 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:26:26,901 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-02-14T10:26:26,904 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:26:26,905 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:26:26,907 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:26:26,909 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:26:26,911 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:26:26,913 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:26:26,915 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-02-14T10:26:26,917 copying build/lib/lm_eval/tasks/afrobench/adr/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2026-02-14T10:26:26,919 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner 2026-02-14T10:26:26,921 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,922 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,925 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,927 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,929 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,930 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,932 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,934 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,937 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,938 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,940 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,942 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,944 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,946 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,948 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,950 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,951 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,953 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,955 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,957 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,959 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,961 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,963 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-02-14T10:26:26,966 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,967 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,970 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,972 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,974 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,976 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,978 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,979 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,981 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,983 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,984 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,986 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,988 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,990 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,992 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,994 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,996 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,997 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:26,999 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:27,001 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:27,003 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:27,005 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:27,008 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-02-14T10:26:27,010 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,011 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,014 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,016 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,018 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,020 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,021 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,023 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,025 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,027 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,029 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,031 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,033 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,035 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,037 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,039 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,041 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,043 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,045 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,047 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,049 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,051 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,054 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-02-14T10:26:27,056 copying build/lib/lm_eval/tasks/afrobench/masakhaner/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2026-02-14T10:26:27,059 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,060 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,062 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,064 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,066 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,069 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,071 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,073 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,076 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,078 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,081 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,084 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,086 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,088 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,090 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,092 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,094 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,096 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,098 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,100 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,103 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,105 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,109 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-02-14T10:26:27,112 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,113 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,115 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,117 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,119 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,121 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,124 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,126 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,128 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,130 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,133 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,135 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,137 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,140 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,142 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,144 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,147 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,149 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,152 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,154 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,156 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,159 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,161 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-02-14T10:26:27,164 copying build/lib/lm_eval/tasks/afrobench/masakhaner/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2026-02-14T10:26:27,167 copying build/lib/lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2026-02-14T10:26:27,170 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc 2026-02-14T10:26:27,172 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-02-14T10:26:27,173 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-02-14T10:26:27,176 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-02-14T10:26:27,178 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-02-14T10:26:27,181 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-02-14T10:26:27,183 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-02-14T10:26:27,185 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-02-14T10:26:27,188 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-02-14T10:26:27,190 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-02-14T10:26:27,192 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-02-14T10:26:27,196 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-02-14T10:26:27,197 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-02-14T10:26:27,200 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-02-14T10:26:27,202 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-02-14T10:26:27,204 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-02-14T10:26:27,207 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-02-14T10:26:27,209 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-02-14T10:26:27,211 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-02-14T10:26:27,214 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-02-14T10:26:27,216 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-02-14T10:26:27,219 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-02-14T10:26:27,220 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-02-14T10:26:27,222 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-02-14T10:26:27,224 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-02-14T10:26:27,226 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-02-14T10:26:27,228 copying build/lib/lm_eval/tasks/afrobench/naijarc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2026-02-14T10:26:27,230 copying build/lib/lm_eval/tasks/afrobench/naijarc/naijarc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2026-02-14T10:26:27,231 copying build/lib/lm_eval/tasks/afrobench/naijarc/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2026-02-14T10:26:27,234 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex 2026-02-14T10:26:27,236 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1 2026-02-14T10:26:27,238 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,239 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,241 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,243 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,244 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,246 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,248 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,250 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,252 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,254 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,256 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,258 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,260 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,262 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,264 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,266 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,267 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,269 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,271 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,273 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,275 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,276 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,278 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,280 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,282 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,284 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,286 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,288 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,290 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,292 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,294 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,296 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,298 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,300 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-02-14T10:26:27,303 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,304 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,306 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,308 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,310 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,312 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,314 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,316 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,318 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,320 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,322 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,324 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,326 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,328 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,330 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,332 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,334 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,335 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,337 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,340 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,341 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,343 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,345 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,347 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,349 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,351 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,352 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,355 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,357 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,358 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,360 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,362 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,364 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,366 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-02-14T10:26:27,368 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2 2026-02-14T10:26:27,371 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,372 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,374 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,376 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,378 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,380 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,382 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,384 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,386 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,387 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,389 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,391 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,393 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,395 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,397 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,399 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,401 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,403 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,405 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,407 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,409 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,411 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,413 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,415 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,417 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,419 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,421 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,423 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,424 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,426 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,428 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,430 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,432 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,434 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-02-14T10:26:27,437 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,438 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,441 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,443 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,446 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,449 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,451 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,453 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,455 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,457 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,459 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,461 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,463 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,465 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,467 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,469 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,471 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,473 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,475 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,477 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,479 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,481 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,483 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,485 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,487 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,489 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,491 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,493 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,495 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,497 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,499 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,501 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,503 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,505 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-02-14T10:26:27,507 copying build/lib/lm_eval/tasks/afrobench/ntrex/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2026-02-14T10:26:27,510 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3 2026-02-14T10:26:27,512 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,514 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,516 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,518 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,520 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,522 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,524 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,526 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,528 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,530 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,533 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,534 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,537 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,539 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,541 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,543 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,545 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,547 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,549 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,551 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,553 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,555 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,557 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,559 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,561 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,563 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,565 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,567 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,569 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,571 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,574 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,576 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,578 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,580 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-02-14T10:26:27,583 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,585 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,587 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,589 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,591 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,593 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,595 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,598 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,599 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,602 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,604 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,606 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,608 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,610 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,612 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,614 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,616 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,618 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,620 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,622 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,624 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,625 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,627 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,629 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,632 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,634 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,636 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,638 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,640 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,642 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,644 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,646 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,648 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,650 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-02-14T10:26:27,652 copying build/lib/lm_eval/tasks/afrobench/ntrex/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2026-02-14T10:26:27,654 copying build/lib/lm_eval/tasks/afrobench/ntrex/ntrex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2026-02-14T10:26:27,656 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt 2026-02-14T10:26:27,658 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,659 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,662 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,664 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,666 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,667 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,669 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,671 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,673 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,675 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,677 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,679 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,681 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,683 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,685 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,687 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-02-14T10:26:27,690 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,691 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,693 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,695 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,697 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,699 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,701 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,703 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,705 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,707 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,709 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,711 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,713 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,715 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,717 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,719 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-02-14T10:26:27,721 copying build/lib/lm_eval/tasks/afrobench/salt/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2026-02-14T10:26:27,724 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,725 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,727 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,729 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,731 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,733 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,736 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,738 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,740 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,742 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,744 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,746 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,748 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,750 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,752 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,754 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-02-14T10:26:27,756 copying build/lib/lm_eval/tasks/afrobench/salt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2026-02-14T10:26:27,758 copying build/lib/lm_eval/tasks/afrobench/salt/salt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2026-02-14T10:26:27,760 copying build/lib/lm_eval/tasks/afrobench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2026-02-14T10:26:27,763 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores 2026-02-14T10:26:27,764 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1 2026-02-14T10:26:27,767 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,769 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,771 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,773 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,775 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,777 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,779 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,781 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,783 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,785 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,787 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,789 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,791 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,793 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,794 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,796 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,798 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,800 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,802 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,804 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,806 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,808 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,810 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,812 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,814 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,816 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,818 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,820 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,822 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,823 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,826 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,828 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,830 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,832 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,834 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,836 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,838 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,840 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,842 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,843 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,845 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,848 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,850 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,851 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,853 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,855 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,857 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,859 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,861 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,863 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,866 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,867 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,869 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,871 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,873 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,875 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,877 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,879 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,881 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,883 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,885 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,887 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,889 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,891 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-02-14T10:26:27,894 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,895 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,897 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,899 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,901 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,904 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,905 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,907 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,910 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,912 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,913 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,915 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,917 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,919 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,921 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,923 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,926 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,929 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,931 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,933 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,936 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,938 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,941 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,943 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,946 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,948 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,951 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,953 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,955 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,958 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,960 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,962 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,965 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,967 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,970 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,972 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,974 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,977 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,979 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,982 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,984 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,987 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,990 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,992 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,994 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,997 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:27,999 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,001 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,004 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,006 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,009 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,011 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,013 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,016 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,019 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,021 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,023 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,026 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,028 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,030 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,032 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,034 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,036 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,037 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-02-14T10:26:28,039 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1 2026-02-14T10:26:28,042 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2 2026-02-14T10:26:28,044 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,045 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,047 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,049 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,051 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,053 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,055 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,057 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,059 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,061 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,063 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,065 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,067 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,069 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,071 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,073 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,074 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,077 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,078 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,080 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,082 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,084 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,086 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,088 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,090 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,092 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,094 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,096 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,098 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,100 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,101 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,103 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,105 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,107 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,109 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,111 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,113 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,115 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,117 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,119 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,121 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,123 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,126 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,128 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,130 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,132 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,134 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,137 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,140 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,143 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,145 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,148 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,150 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,152 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,155 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,157 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,159 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,161 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,163 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,166 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,168 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,170 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,173 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,175 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-02-14T10:26:28,179 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,180 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,182 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,185 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,188 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,190 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,192 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,194 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,197 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,199 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,202 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,204 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,206 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,209 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,211 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,213 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,215 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,218 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,220 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,222 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,224 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,226 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,229 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,231 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,234 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,236 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,238 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,240 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,242 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,245 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,247 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,249 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,250 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,252 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,254 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,256 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,258 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,260 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,262 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,263 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,265 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,267 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,269 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,271 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,273 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,274 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,276 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,278 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,280 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,282 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,283 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,285 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,287 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,289 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,291 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,292 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,294 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,296 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,298 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,300 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,302 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,304 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,306 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,308 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-02-14T10:26:28,310 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2 2026-02-14T10:26:28,312 copying build/lib/lm_eval/tasks/afrobench/flores/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2026-02-14T10:26:28,315 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3 2026-02-14T10:26:28,318 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,319 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,321 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,323 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,324 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,326 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,328 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,330 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,332 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,333 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,335 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,337 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,339 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,341 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,343 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,345 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,346 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,348 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,350 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,351 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,353 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,355 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,357 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,358 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,360 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,362 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,364 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,366 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,368 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,369 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,371 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,373 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,376 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,378 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,379 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,381 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,383 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,385 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,387 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,388 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,390 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,392 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,394 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,396 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,398 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,400 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,401 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,403 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,405 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,407 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,409 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,411 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,412 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,414 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,416 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,418 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,420 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,422 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,423 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,427 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,428 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,430 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,432 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,434 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-02-14T10:26:28,437 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,438 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,440 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,442 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,444 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,446 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,448 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,449 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,451 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,453 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,454 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,456 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,458 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,460 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,462 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,464 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,466 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,468 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,470 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,472 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,474 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,476 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,478 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,479 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,481 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,483 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,485 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,487 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,489 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,491 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,492 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,494 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,496 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,498 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,500 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,501 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,503 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,506 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,507 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,509 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,511 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,513 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,515 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,517 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,519 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,521 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,522 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,524 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,526 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,528 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,529 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,531 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,533 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,535 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,536 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,538 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,540 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,542 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,544 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,546 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,548 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,550 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,552 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,553 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-02-14T10:26:28,556 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3 2026-02-14T10:26:28,557 copying build/lib/lm_eval/tasks/afrobench/flores/flores.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2026-02-14T10:26:28,559 copying build/lib/lm_eval/tasks/afrobench/flores/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2026-02-14T10:26:28,561 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele 2026-02-14T10:26:28,564 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,565 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,567 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,569 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,571 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,573 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,574 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,576 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,578 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,580 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,581 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,583 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,585 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,587 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,589 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,591 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,593 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,595 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,596 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,598 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,600 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,602 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,603 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,605 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,607 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,610 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,612 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,614 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,616 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,618 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,619 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,621 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,623 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-02-14T10:26:28,626 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,627 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,629 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,631 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,632 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,634 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,636 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,638 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,639 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,641 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,643 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,644 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,646 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,648 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,650 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,651 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,653 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,655 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,657 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,659 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,661 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,663 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,665 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,667 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,669 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,670 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,672 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,674 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,676 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,678 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,680 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,681 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,683 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-02-14T10:26:28,686 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,687 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,689 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,691 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,692 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,695 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,697 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,698 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,700 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,702 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,704 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,708 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,709 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,711 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,713 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,715 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,717 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,718 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,720 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,722 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,724 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,726 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,727 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,730 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,732 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,734 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,737 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,739 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,741 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,744 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,747 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,749 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,751 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-02-14T10:26:28,755 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,757 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,759 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,762 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,764 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,766 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,769 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,771 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,774 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,776 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,779 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,781 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,783 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,786 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,788 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,791 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,793 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,796 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,798 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,801 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,804 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,807 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,809 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,812 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,814 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,817 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,819 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,821 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,824 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,826 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,829 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,831 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,833 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-02-14T10:26:28,836 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,837 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,839 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,841 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,843 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,845 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,846 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,848 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,850 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,852 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,854 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,856 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,858 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,859 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,861 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,863 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,865 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,867 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,869 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,870 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,872 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,874 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,877 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,878 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,880 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,882 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,884 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,885 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,887 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,889 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,891 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,893 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,895 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-02-14T10:26:28,897 copying build/lib/lm_eval/tasks/afrobench/belebele/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2026-02-14T10:26:28,899 copying build/lib/lm_eval/tasks/afrobench/belebele/belebele.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2026-02-14T10:26:28,901 copying build/lib/lm_eval/tasks/afrobench/belebele/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2026-02-14T10:26:28,904 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sample_run_scripts 2026-02-14T10:26:28,905 copying build/lib/lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sample_run_scripts 2026-02-14T10:26:28,907 copying build/lib/lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sample_run_scripts 2026-02-14T10:26:28,910 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand 2026-02-14T10:26:28,911 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1 2026-02-14T10:26:28,914 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,915 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,917 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,919 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,921 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,923 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,925 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,927 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,928 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,930 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,932 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,934 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,936 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,937 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,939 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,941 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,943 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,945 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,947 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,949 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,951 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,953 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,956 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,958 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-02-14T10:26:28,960 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,961 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,963 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,965 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,967 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,969 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,971 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,973 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,975 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,977 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,979 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,981 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,982 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,984 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,986 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,988 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,990 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,992 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,994 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,995 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:28,999 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:29,001 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:29,003 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:29,005 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-02-14T10:26:29,007 copying build/lib/lm_eval/tasks/afrobench/mafand/mafand.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2026-02-14T10:26:29,009 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2 2026-02-14T10:26:29,011 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,012 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,014 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,016 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,018 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,020 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,022 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,023 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,025 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,027 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,029 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,031 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,033 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,035 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,037 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,039 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,041 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,042 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,044 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,046 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,048 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,050 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,052 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,054 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-02-14T10:26:29,057 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,059 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,061 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,062 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,064 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,066 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,068 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,070 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,072 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,074 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,076 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,078 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,080 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,082 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,083 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,086 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,087 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,089 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,091 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,093 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,095 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,097 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,099 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,101 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-02-14T10:26:29,103 copying build/lib/lm_eval/tasks/afrobench/mafand/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2026-02-14T10:26:29,107 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3 2026-02-14T10:26:29,109 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,110 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,112 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,115 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,117 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,118 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,120 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,122 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,124 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,126 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,127 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,129 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,131 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,133 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,135 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,137 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,139 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,141 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,143 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,145 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,147 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,149 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,151 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,153 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-02-14T10:26:29,157 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,158 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,160 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,162 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,164 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,166 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,168 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,170 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,172 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,174 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,176 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,178 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,180 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,182 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,184 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,186 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,188 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,190 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,192 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,194 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,197 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,199 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,201 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,203 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-02-14T10:26:29,205 copying build/lib/lm_eval/tasks/afrobench/mafand/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2026-02-14T10:26:29,208 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent 2026-02-14T10:26:29,209 copying build/lib/lm_eval/tasks/afrobench/injongointent/injongointent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2026-02-14T10:26:29,212 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,213 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,215 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,217 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,219 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,221 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,223 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,224 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,226 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,228 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,230 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,232 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,234 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,236 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,238 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,240 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,242 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,244 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,246 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,247 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-02-14T10:26:29,250 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,251 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,253 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,255 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,257 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,259 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,261 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,263 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,264 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,266 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,268 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,270 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,272 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,274 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,276 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,279 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,280 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,282 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,284 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,286 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-02-14T10:26:29,289 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,290 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,292 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,294 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,295 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,297 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,299 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,301 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,303 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,306 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,309 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,312 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,313 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,315 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,317 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,319 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,321 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,323 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,325 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,327 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-02-14T10:26:29,328 copying build/lib/lm_eval/tasks/afrobench/injongointent/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2026-02-14T10:26:29,331 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,332 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,334 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,336 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,338 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,340 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,342 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,344 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,346 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,348 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,349 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,351 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,353 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,355 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,357 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,359 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,361 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,363 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,365 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,367 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-02-14T10:26:29,370 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,371 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,373 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,374 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,376 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,378 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,380 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,382 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,384 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,386 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,388 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,390 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,392 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,395 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,397 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,399 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,401 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,403 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,406 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,407 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-02-14T10:26:29,410 copying build/lib/lm_eval/tasks/afrobench/injongointent/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2026-02-14T10:26:29,413 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti 2026-02-14T10:26:29,414 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,416 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,418 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,419 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,421 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,423 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,425 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,427 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,429 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,431 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,433 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,435 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,437 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,438 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,440 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,442 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,444 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,446 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,448 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-02-14T10:26:29,450 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,451 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,453 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,455 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,457 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,459 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,461 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,463 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,465 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,467 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,469 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,470 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,472 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,474 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,477 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,478 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,480 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,482 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-02-14T10:26:29,485 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,486 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,488 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,490 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,492 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,494 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,496 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,498 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,500 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,502 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,504 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,505 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,507 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,509 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,511 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,513 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,515 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,517 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,518 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-02-14T10:26:29,521 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,522 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,524 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,526 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,528 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,530 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,531 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,533 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,536 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,537 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,539 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,543 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,545 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,547 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,549 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,551 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,553 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,555 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-02-14T10:26:29,557 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,558 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,560 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,562 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,564 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,566 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,568 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,570 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,571 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,574 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,576 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,578 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,580 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,582 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,583 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,586 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,588 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,590 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-02-14T10:26:29,592 copying build/lib/lm_eval/tasks/afrobench/afrisenti/fewshot.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-02-14T10:26:29,596 copying build/lib/lm_eval/tasks/afrobench/afrisenti/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-02-14T10:26:29,598 copying build/lib/lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-02-14T10:26:29,600 copying build/lib/lm_eval/tasks/afrobench/afrisenti/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-02-14T10:26:29,603 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib 2026-02-14T10:26:29,606 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,607 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,610 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,612 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,613 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,615 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,617 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,619 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,622 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,625 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,627 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,629 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,631 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,633 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,635 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,637 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,639 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,642 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,644 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,647 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,649 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,651 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,653 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,655 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,657 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,659 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,660 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,662 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,664 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,667 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,670 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,672 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,675 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,679 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,682 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,686 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,688 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,690 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,692 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,693 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,695 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,697 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,699 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,701 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,703 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,704 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,706 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,708 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,710 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,712 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,714 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,716 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,718 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,720 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,722 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,724 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,726 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,728 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,731 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-02-14T10:26:29,734 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,735 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,737 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,739 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,741 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,743 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,745 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,747 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,749 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,751 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,753 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,755 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,757 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,760 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,762 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,766 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,769 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,772 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,774 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,776 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,778 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,780 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,781 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,783 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,785 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,787 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,789 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,791 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,793 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,795 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,797 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,798 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,800 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,802 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,804 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,806 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,809 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,811 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,813 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,816 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,818 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,820 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,822 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,823 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,825 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,827 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,829 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,831 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,833 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,835 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,837 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,839 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,841 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,843 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,845 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,847 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,849 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,852 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,854 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-02-14T10:26:29,857 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,858 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,860 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,862 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,864 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,866 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,868 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,870 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,871 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,873 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,875 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,877 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,879 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,881 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,883 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,885 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,887 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,889 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,890 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,892 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:29,894 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,116 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,118 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,120 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,122 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,124 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,126 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,128 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,129 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,131 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,133 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,135 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,137 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,139 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,141 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,143 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,145 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,147 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,150 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,152 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,155 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,157 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,159 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,161 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,163 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,164 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,166 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,168 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,170 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,172 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,173 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,175 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,178 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,180 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,182 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,183 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,185 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,187 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,189 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-02-14T10:26:30,192 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,193 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,195 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,197 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,199 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,201 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,203 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,205 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,206 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,208 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,210 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,212 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,214 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,216 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,217 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,219 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,221 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,223 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,225 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,227 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,228 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,230 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,232 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,234 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,236 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,238 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,240 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,243 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,245 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,248 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,251 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,253 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,256 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,258 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,261 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,263 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,266 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,268 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,271 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,273 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,276 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,278 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,281 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,283 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,286 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,288 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,291 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,293 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,296 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,299 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,302 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,305 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,308 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,310 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,313 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,315 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,318 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,320 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,323 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-02-14T10:26:30,327 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,329 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,331 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,334 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,337 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,340 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,342 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,344 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,346 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,348 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,350 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,352 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,354 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,355 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,357 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,359 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,361 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,363 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,365 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,367 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,369 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,371 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,372 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,374 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,376 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,378 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,381 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,383 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,385 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,387 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,389 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,392 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,393 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,395 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,397 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,399 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,401 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,403 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,405 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,407 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,408 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,410 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,412 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,414 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,416 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,418 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,420 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,421 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,423 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,425 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,427 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,429 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,431 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,433 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,435 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,437 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,438 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,440 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,442 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-02-14T10:26:30,444 copying build/lib/lm_eval/tasks/afrobench/sib/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2026-02-14T10:26:30,446 copying build/lib/lm_eval/tasks/afrobench/sib/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2026-02-14T10:26:30,448 copying build/lib/lm_eval/tasks/afrobench/sib/sib.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2026-02-14T10:26:30,451 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum 2026-02-14T10:26:30,452 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,453 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,455 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,457 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,459 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,461 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,463 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,465 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,466 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,468 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,470 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,472 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,474 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,476 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,478 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-02-14T10:26:30,480 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,481 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,483 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,485 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,487 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,489 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,490 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,492 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,494 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,496 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,497 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,499 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,501 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,503 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,504 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-02-14T10:26:30,506 copying build/lib/lm_eval/tasks/afrobench/xlsum/xlsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2026-02-14T10:26:30,509 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,510 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,512 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,514 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,516 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,517 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,519 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,521 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,523 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,525 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,527 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,528 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,530 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,532 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,533 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-02-14T10:26:30,535 copying build/lib/lm_eval/tasks/afrobench/xlsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2026-02-14T10:26:30,538 copying build/lib/lm_eval/tasks/afrobench/xlsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2026-02-14T10:26:30,540 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa 2026-02-14T10:26:30,542 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,543 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,545 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,547 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,549 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,551 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,553 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,554 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,556 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,558 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,560 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,562 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-02-14T10:26:30,565 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,566 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,568 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,570 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,572 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,574 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,576 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,578 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,580 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,581 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,583 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,585 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-02-14T10:26:30,588 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,589 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,591 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,593 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,595 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,596 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,598 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,600 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,602 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,604 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,606 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,608 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-02-14T10:26:30,610 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,611 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,613 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,615 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,617 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,619 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,621 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,623 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,625 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,627 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,629 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,630 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-02-14T10:26:30,633 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,634 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,637 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,639 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,642 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,644 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,646 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,648 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,650 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,653 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,654 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,656 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-02-14T10:26:30,658 copying build/lib/lm_eval/tasks/afrobench/afriqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2026-02-14T10:26:30,660 copying build/lib/lm_eval/tasks/afrobench/afriqa/afriqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2026-02-14T10:26:30,662 copying build/lib/lm_eval/tasks/afrobench/afriqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2026-02-14T10:26:30,664 copying build/lib/lm_eval/tasks/afrobench/afrobench-lite.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2026-02-14T10:26:30,666 copying build/lib/lm_eval/tasks/afrobench/afrobench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2026-02-14T10:26:30,669 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos 2026-02-14T10:26:30,670 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,671 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,673 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,675 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,677 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,679 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,681 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,682 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,684 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,686 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,688 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,690 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,692 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,694 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,696 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,698 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,700 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,702 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,705 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,707 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,709 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,711 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,713 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-02-14T10:26:30,716 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,717 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,719 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,721 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,723 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,725 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,727 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,729 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,731 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,733 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,735 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,737 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,739 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,741 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,743 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,745 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,748 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,750 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,752 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,754 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,757 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,759 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,761 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-02-14T10:26:30,764 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,765 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,767 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,768 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,770 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,772 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,774 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,776 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,778 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,780 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,782 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,783 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,785 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,787 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,789 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,791 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,793 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,795 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,796 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,798 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,800 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,802 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,804 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-02-14T10:26:30,806 copying build/lib/lm_eval/tasks/afrobench/masakhapos/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-02-14T10:26:30,808 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,809 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,811 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,813 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,815 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,817 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,819 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,821 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,823 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,825 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,826 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,828 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,830 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,832 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,834 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,836 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,838 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,840 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,841 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,843 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,845 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,847 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,849 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-02-14T10:26:30,852 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,853 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,856 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,858 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,860 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,862 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,865 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,867 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,869 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,871 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,873 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,875 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,877 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,879 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,882 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,883 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,886 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,888 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,890 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,892 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,894 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,896 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,898 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-02-14T10:26:30,900 copying build/lib/lm_eval/tasks/afrobench/masakhapos/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-02-14T10:26:30,902 copying build/lib/lm_eval/tasks/afrobench/masakhapos/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-02-14T10:26:30,904 copying build/lib/lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-02-14T10:26:30,907 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ruler 2026-02-14T10:26:30,908 copying build/lib/lm_eval/tasks/ruler/niah_multikey_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,910 copying build/lib/lm_eval/tasks/ruler/essays.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,913 copying build/lib/lm_eval/tasks/ruler/niah_multiquery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,914 copying build/lib/lm_eval/tasks/ruler/qa_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,917 copying build/lib/lm_eval/tasks/ruler/niah_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,919 copying build/lib/lm_eval/tasks/ruler/fwe_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,922 copying build/lib/lm_eval/tasks/ruler/ruler.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,924 copying build/lib/lm_eval/tasks/ruler/common_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,926 copying build/lib/lm_eval/tasks/ruler/niah_single_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,928 copying build/lib/lm_eval/tasks/ruler/niah_multikey_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,930 copying build/lib/lm_eval/tasks/ruler/vt_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,933 copying build/lib/lm_eval/tasks/ruler/niah_multivalue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,935 copying build/lib/lm_eval/tasks/ruler/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,937 copying build/lib/lm_eval/tasks/ruler/niah_single_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,939 copying build/lib/lm_eval/tasks/ruler/niah_multikey_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,941 copying build/lib/lm_eval/tasks/ruler/qa_hotpot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,943 copying build/lib/lm_eval/tasks/ruler/vt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,945 copying build/lib/lm_eval/tasks/ruler/fwe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,947 copying build/lib/lm_eval/tasks/ruler/cwe_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,950 copying build/lib/lm_eval/tasks/ruler/qa_squad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,951 copying build/lib/lm_eval/tasks/ruler/prepare_niah.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,954 copying build/lib/lm_eval/tasks/ruler/cwe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,957 copying build/lib/lm_eval/tasks/ruler/niah_single_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-02-14T10:26:30,960 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile 2026-02-14T10:26:30,961 copying build/lib/lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,963 copying build/lib/lm_eval/tasks/pile/pile_philpapers.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,965 copying build/lib/lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,966 copying build/lib/lm_eval/tasks/pile/pile_gutenberg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,968 copying build/lib/lm_eval/tasks/pile/pile_books3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,970 copying build/lib/lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,972 copying build/lib/lm_eval/tasks/pile/pile_wikipedia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,974 copying build/lib/lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,976 copying build/lib/lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,978 copying build/lib/lm_eval/tasks/pile/pile_freelaw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,980 copying build/lib/lm_eval/tasks/pile/pile_stackexchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,981 copying build/lib/lm_eval/tasks/pile/pile_github.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,983 copying build/lib/lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,985 copying build/lib/lm_eval/tasks/pile/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,987 copying build/lib/lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,989 copying build/lib/lm_eval/tasks/pile/pile_europarl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,992 copying build/lib/lm_eval/tasks/pile/pile_pile-cc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,994 copying build/lib/lm_eval/tasks/pile/pile_uspto.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,996 copying build/lib/lm_eval/tasks/pile/pile_enron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,998 copying build/lib/lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:30,999 copying build/lib/lm_eval/tasks/pile/pile_hackernews.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:31,001 copying build/lib/lm_eval/tasks/pile/pile_arxiv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:31,003 copying build/lib/lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-02-14T10:26:31,005 copying build/lib/lm_eval/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-02-14T10:26:31,009 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,010 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,012 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,014 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,016 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,018 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,020 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,022 copying build/lib/lm_eval/tasks/arab_culture_completion/prompts.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,024 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,026 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,028 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,030 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,032 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,034 copying build/lib/lm_eval/tasks/arab_culture_completion/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,036 copying build/lib/lm_eval/tasks/arab_culture_completion/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,038 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,040 copying build/lib/lm_eval/tasks/arab_culture_completion/utils_completion.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,042 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,044 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,046 copying build/lib/lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,048 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,050 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,053 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,055 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-02-14T10:26:31,058 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basqueglue 2026-02-14T10:26:31,060 copying build/lib/lm_eval/tasks/basqueglue/bhtc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-02-14T10:26:31,062 copying build/lib/lm_eval/tasks/basqueglue/vaxx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-02-14T10:26:31,064 copying build/lib/lm_eval/tasks/basqueglue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-02-14T10:26:31,067 copying build/lib/lm_eval/tasks/basqueglue/wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-02-14T10:26:31,069 copying build/lib/lm_eval/tasks/basqueglue/qnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-02-14T10:26:31,071 copying build/lib/lm_eval/tasks/basqueglue/coref.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-02-14T10:26:31,074 copying build/lib/lm_eval/tasks/basqueglue/bec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-02-14T10:26:31,076 copying build/lib/lm_eval/tasks/basqueglue/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-02-14T10:26:31,080 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa 2026-02-14T10:26:31,085 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,086 copying build/lib/lm_eval/tasks/global_piqa/prompted/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,089 copying build/lib/lm_eval/tasks/global_piqa/prompted/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,092 copying build/lib/lm_eval/tasks/global_piqa/prompted/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,094 copying build/lib/lm_eval/tasks/global_piqa/prompted/bos_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,097 copying build/lib/lm_eval/tasks/global_piqa/prompted/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,099 copying build/lib/lm_eval/tasks/global_piqa/prompted/kaz_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,101 copying build/lib/lm_eval/tasks/global_piqa/prompted/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,104 copying build/lib/lm_eval/tasks/global_piqa/prompted/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,107 copying build/lib/lm_eval/tasks/global_piqa/prompted/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,109 copying build/lib/lm_eval/tasks/global_piqa/prompted/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,111 copying build/lib/lm_eval/tasks/global_piqa/prompted/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,114 copying build/lib/lm_eval/tasks/global_piqa/prompted/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,117 copying build/lib/lm_eval/tasks/global_piqa/prompted/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,119 copying build/lib/lm_eval/tasks/global_piqa/prompted/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,122 copying build/lib/lm_eval/tasks/global_piqa/prompted/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,125 copying build/lib/lm_eval/tasks/global_piqa/prompted/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,127 copying build/lib/lm_eval/tasks/global_piqa/prompted/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,129 copying build/lib/lm_eval/tasks/global_piqa/prompted/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,131 copying build/lib/lm_eval/tasks/global_piqa/prompted/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,134 copying build/lib/lm_eval/tasks/global_piqa/prompted/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,136 copying build/lib/lm_eval/tasks/global_piqa/prompted/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,139 copying build/lib/lm_eval/tasks/global_piqa/prompted/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,141 copying build/lib/lm_eval/tasks/global_piqa/prompted/_global_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,144 copying build/lib/lm_eval/tasks/global_piqa/prompted/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,147 copying build/lib/lm_eval/tasks/global_piqa/prompted/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,148 copying build/lib/lm_eval/tasks/global_piqa/prompted/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,150 copying build/lib/lm_eval/tasks/global_piqa/prompted/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,152 copying build/lib/lm_eval/tasks/global_piqa/prompted/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,154 copying build/lib/lm_eval/tasks/global_piqa/prompted/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,156 copying build/lib/lm_eval/tasks/global_piqa/prompted/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,158 copying build/lib/lm_eval/tasks/global_piqa/prompted/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,160 copying build/lib/lm_eval/tasks/global_piqa/prompted/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,162 copying build/lib/lm_eval/tasks/global_piqa/prompted/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,164 copying build/lib/lm_eval/tasks/global_piqa/prompted/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,166 copying build/lib/lm_eval/tasks/global_piqa/prompted/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,168 copying build/lib/lm_eval/tasks/global_piqa/prompted/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,170 copying build/lib/lm_eval/tasks/global_piqa/prompted/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,172 copying build/lib/lm_eval/tasks/global_piqa/prompted/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,174 copying build/lib/lm_eval/tasks/global_piqa/prompted/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,176 copying build/lib/lm_eval/tasks/global_piqa/prompted/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,179 copying build/lib/lm_eval/tasks/global_piqa/prompted/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,181 copying build/lib/lm_eval/tasks/global_piqa/prompted/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,183 copying build/lib/lm_eval/tasks/global_piqa/prompted/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,185 copying build/lib/lm_eval/tasks/global_piqa/prompted/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,187 copying build/lib/lm_eval/tasks/global_piqa/prompted/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,189 copying build/lib/lm_eval/tasks/global_piqa/prompted/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,190 copying build/lib/lm_eval/tasks/global_piqa/prompted/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,193 copying build/lib/lm_eval/tasks/global_piqa/prompted/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,194 copying build/lib/lm_eval/tasks/global_piqa/prompted/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,196 copying build/lib/lm_eval/tasks/global_piqa/prompted/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,198 copying build/lib/lm_eval/tasks/global_piqa/prompted/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,200 copying build/lib/lm_eval/tasks/global_piqa/prompted/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,202 copying build/lib/lm_eval/tasks/global_piqa/prompted/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,205 copying build/lib/lm_eval/tasks/global_piqa/prompted/luo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,207 copying build/lib/lm_eval/tasks/global_piqa/prompted/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,209 copying build/lib/lm_eval/tasks/global_piqa/prompted/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,211 copying build/lib/lm_eval/tasks/global_piqa/prompted/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,213 copying build/lib/lm_eval/tasks/global_piqa/prompted/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,215 copying build/lib/lm_eval/tasks/global_piqa/prompted/bsk_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,217 copying build/lib/lm_eval/tasks/global_piqa/prompted/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,219 copying build/lib/lm_eval/tasks/global_piqa/prompted/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,221 copying build/lib/lm_eval/tasks/global_piqa/prompted/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,223 copying build/lib/lm_eval/tasks/global_piqa/prompted/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,226 copying build/lib/lm_eval/tasks/global_piqa/prompted/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,228 copying build/lib/lm_eval/tasks/global_piqa/prompted/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,230 copying build/lib/lm_eval/tasks/global_piqa/prompted/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,232 copying build/lib/lm_eval/tasks/global_piqa/prompted/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,234 copying build/lib/lm_eval/tasks/global_piqa/prompted/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,236 copying build/lib/lm_eval/tasks/global_piqa/prompted/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,238 copying build/lib/lm_eval/tasks/global_piqa/prompted/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,240 copying build/lib/lm_eval/tasks/global_piqa/prompted/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,242 copying build/lib/lm_eval/tasks/global_piqa/prompted/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,244 copying build/lib/lm_eval/tasks/global_piqa/prompted/asm_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,246 copying build/lib/lm_eval/tasks/global_piqa/prompted/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,248 copying build/lib/lm_eval/tasks/global_piqa/prompted/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,250 copying build/lib/lm_eval/tasks/global_piqa/prompted/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,252 copying build/lib/lm_eval/tasks/global_piqa/prompted/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,254 copying build/lib/lm_eval/tasks/global_piqa/prompted/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,256 copying build/lib/lm_eval/tasks/global_piqa/prompted/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,258 copying build/lib/lm_eval/tasks/global_piqa/prompted/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,260 copying build/lib/lm_eval/tasks/global_piqa/prompted/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,262 copying build/lib/lm_eval/tasks/global_piqa/prompted/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,264 copying build/lib/lm_eval/tasks/global_piqa/prompted/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,266 copying build/lib/lm_eval/tasks/global_piqa/prompted/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,268 copying build/lib/lm_eval/tasks/global_piqa/prompted/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,270 copying build/lib/lm_eval/tasks/global_piqa/prompted/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,272 copying build/lib/lm_eval/tasks/global_piqa/prompted/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,274 copying build/lib/lm_eval/tasks/global_piqa/prompted/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,276 copying build/lib/lm_eval/tasks/global_piqa/prompted/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,278 copying build/lib/lm_eval/tasks/global_piqa/prompted/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,280 copying build/lib/lm_eval/tasks/global_piqa/prompted/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,282 copying build/lib/lm_eval/tasks/global_piqa/prompted/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,284 copying build/lib/lm_eval/tasks/global_piqa/prompted/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,286 copying build/lib/lm_eval/tasks/global_piqa/prompted/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,288 copying build/lib/lm_eval/tasks/global_piqa/prompted/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,290 copying build/lib/lm_eval/tasks/global_piqa/prompted/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,292 copying build/lib/lm_eval/tasks/global_piqa/prompted/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,294 copying build/lib/lm_eval/tasks/global_piqa/prompted/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,296 copying build/lib/lm_eval/tasks/global_piqa/prompted/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,298 copying build/lib/lm_eval/tasks/global_piqa/prompted/ckb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,300 copying build/lib/lm_eval/tasks/global_piqa/prompted/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,302 copying build/lib/lm_eval/tasks/global_piqa/prompted/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,304 copying build/lib/lm_eval/tasks/global_piqa/prompted/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,306 copying build/lib/lm_eval/tasks/global_piqa/prompted/mni_mtei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,308 copying build/lib/lm_eval/tasks/global_piqa/prompted/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,310 copying build/lib/lm_eval/tasks/global_piqa/prompted/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,312 copying build/lib/lm_eval/tasks/global_piqa/prompted/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,314 copying build/lib/lm_eval/tasks/global_piqa/prompted/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,316 copying build/lib/lm_eval/tasks/global_piqa/prompted/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,318 copying build/lib/lm_eval/tasks/global_piqa/prompted/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,321 copying build/lib/lm_eval/tasks/global_piqa/prompted/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,323 copying build/lib/lm_eval/tasks/global_piqa/prompted/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,325 copying build/lib/lm_eval/tasks/global_piqa/prompted/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,327 copying build/lib/lm_eval/tasks/global_piqa/prompted/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,329 copying build/lib/lm_eval/tasks/global_piqa/prompted/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,331 copying build/lib/lm_eval/tasks/global_piqa/prompted/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,333 copying build/lib/lm_eval/tasks/global_piqa/prompted/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,335 copying build/lib/lm_eval/tasks/global_piqa/prompted/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,337 copying build/lib/lm_eval/tasks/global_piqa/prompted/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/prompted 2026-02-14T10:26:31,339 copying build/lib/lm_eval/tasks/global_piqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa 2026-02-14T10:26:31,344 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,345 copying build/lib/lm_eval/tasks/global_piqa/completions/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,348 copying build/lib/lm_eval/tasks/global_piqa/completions/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,350 copying build/lib/lm_eval/tasks/global_piqa/completions/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,352 copying build/lib/lm_eval/tasks/global_piqa/completions/bos_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,354 copying build/lib/lm_eval/tasks/global_piqa/completions/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,357 copying build/lib/lm_eval/tasks/global_piqa/completions/kaz_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,359 copying build/lib/lm_eval/tasks/global_piqa/completions/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,361 copying build/lib/lm_eval/tasks/global_piqa/completions/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,363 copying build/lib/lm_eval/tasks/global_piqa/completions/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,365 copying build/lib/lm_eval/tasks/global_piqa/completions/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,368 copying build/lib/lm_eval/tasks/global_piqa/completions/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,371 copying build/lib/lm_eval/tasks/global_piqa/completions/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,373 copying build/lib/lm_eval/tasks/global_piqa/completions/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,375 copying build/lib/lm_eval/tasks/global_piqa/completions/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,377 copying build/lib/lm_eval/tasks/global_piqa/completions/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,379 copying build/lib/lm_eval/tasks/global_piqa/completions/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,381 copying build/lib/lm_eval/tasks/global_piqa/completions/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,383 copying build/lib/lm_eval/tasks/global_piqa/completions/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,385 copying build/lib/lm_eval/tasks/global_piqa/completions/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,387 copying build/lib/lm_eval/tasks/global_piqa/completions/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,389 copying build/lib/lm_eval/tasks/global_piqa/completions/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,391 copying build/lib/lm_eval/tasks/global_piqa/completions/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,393 copying build/lib/lm_eval/tasks/global_piqa/completions/_global_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,396 copying build/lib/lm_eval/tasks/global_piqa/completions/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,398 copying build/lib/lm_eval/tasks/global_piqa/completions/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,400 copying build/lib/lm_eval/tasks/global_piqa/completions/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,402 copying build/lib/lm_eval/tasks/global_piqa/completions/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,404 copying build/lib/lm_eval/tasks/global_piqa/completions/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,406 copying build/lib/lm_eval/tasks/global_piqa/completions/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,408 copying build/lib/lm_eval/tasks/global_piqa/completions/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,410 copying build/lib/lm_eval/tasks/global_piqa/completions/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,411 copying build/lib/lm_eval/tasks/global_piqa/completions/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,413 copying build/lib/lm_eval/tasks/global_piqa/completions/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,415 copying build/lib/lm_eval/tasks/global_piqa/completions/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,417 copying build/lib/lm_eval/tasks/global_piqa/completions/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,419 copying build/lib/lm_eval/tasks/global_piqa/completions/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,421 copying build/lib/lm_eval/tasks/global_piqa/completions/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,423 copying build/lib/lm_eval/tasks/global_piqa/completions/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,425 copying build/lib/lm_eval/tasks/global_piqa/completions/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,427 copying build/lib/lm_eval/tasks/global_piqa/completions/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,429 copying build/lib/lm_eval/tasks/global_piqa/completions/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,431 copying build/lib/lm_eval/tasks/global_piqa/completions/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,433 copying build/lib/lm_eval/tasks/global_piqa/completions/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,435 copying build/lib/lm_eval/tasks/global_piqa/completions/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,437 copying build/lib/lm_eval/tasks/global_piqa/completions/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,439 copying build/lib/lm_eval/tasks/global_piqa/completions/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,441 copying build/lib/lm_eval/tasks/global_piqa/completions/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,443 copying build/lib/lm_eval/tasks/global_piqa/completions/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,446 copying build/lib/lm_eval/tasks/global_piqa/completions/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,448 copying build/lib/lm_eval/tasks/global_piqa/completions/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,450 copying build/lib/lm_eval/tasks/global_piqa/completions/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,452 copying build/lib/lm_eval/tasks/global_piqa/completions/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,454 copying build/lib/lm_eval/tasks/global_piqa/completions/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,456 copying build/lib/lm_eval/tasks/global_piqa/completions/luo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,458 copying build/lib/lm_eval/tasks/global_piqa/completions/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,459 copying build/lib/lm_eval/tasks/global_piqa/completions/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,461 copying build/lib/lm_eval/tasks/global_piqa/completions/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,464 copying build/lib/lm_eval/tasks/global_piqa/completions/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,466 copying build/lib/lm_eval/tasks/global_piqa/completions/bsk_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,468 copying build/lib/lm_eval/tasks/global_piqa/completions/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,470 copying build/lib/lm_eval/tasks/global_piqa/completions/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,472 copying build/lib/lm_eval/tasks/global_piqa/completions/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,474 copying build/lib/lm_eval/tasks/global_piqa/completions/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,476 copying build/lib/lm_eval/tasks/global_piqa/completions/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,478 copying build/lib/lm_eval/tasks/global_piqa/completions/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,479 copying build/lib/lm_eval/tasks/global_piqa/completions/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,481 copying build/lib/lm_eval/tasks/global_piqa/completions/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,484 copying build/lib/lm_eval/tasks/global_piqa/completions/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,486 copying build/lib/lm_eval/tasks/global_piqa/completions/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,489 copying build/lib/lm_eval/tasks/global_piqa/completions/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,491 copying build/lib/lm_eval/tasks/global_piqa/completions/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,493 copying build/lib/lm_eval/tasks/global_piqa/completions/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,495 copying build/lib/lm_eval/tasks/global_piqa/completions/asm_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,497 copying build/lib/lm_eval/tasks/global_piqa/completions/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,499 copying build/lib/lm_eval/tasks/global_piqa/completions/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,501 copying build/lib/lm_eval/tasks/global_piqa/completions/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,503 copying build/lib/lm_eval/tasks/global_piqa/completions/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,506 copying build/lib/lm_eval/tasks/global_piqa/completions/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,508 copying build/lib/lm_eval/tasks/global_piqa/completions/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,510 copying build/lib/lm_eval/tasks/global_piqa/completions/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,512 copying build/lib/lm_eval/tasks/global_piqa/completions/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,514 copying build/lib/lm_eval/tasks/global_piqa/completions/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,516 copying build/lib/lm_eval/tasks/global_piqa/completions/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,518 copying build/lib/lm_eval/tasks/global_piqa/completions/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,520 copying build/lib/lm_eval/tasks/global_piqa/completions/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,522 copying build/lib/lm_eval/tasks/global_piqa/completions/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,525 copying build/lib/lm_eval/tasks/global_piqa/completions/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,527 copying build/lib/lm_eval/tasks/global_piqa/completions/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,529 copying build/lib/lm_eval/tasks/global_piqa/completions/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,531 copying build/lib/lm_eval/tasks/global_piqa/completions/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,533 copying build/lib/lm_eval/tasks/global_piqa/completions/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,536 copying build/lib/lm_eval/tasks/global_piqa/completions/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,538 copying build/lib/lm_eval/tasks/global_piqa/completions/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,540 copying build/lib/lm_eval/tasks/global_piqa/completions/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,543 copying build/lib/lm_eval/tasks/global_piqa/completions/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,545 copying build/lib/lm_eval/tasks/global_piqa/completions/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,548 copying build/lib/lm_eval/tasks/global_piqa/completions/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,550 copying build/lib/lm_eval/tasks/global_piqa/completions/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,552 copying build/lib/lm_eval/tasks/global_piqa/completions/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,554 copying build/lib/lm_eval/tasks/global_piqa/completions/ckb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,556 copying build/lib/lm_eval/tasks/global_piqa/completions/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,558 copying build/lib/lm_eval/tasks/global_piqa/completions/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,560 copying build/lib/lm_eval/tasks/global_piqa/completions/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,563 copying build/lib/lm_eval/tasks/global_piqa/completions/mni_mtei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,565 copying build/lib/lm_eval/tasks/global_piqa/completions/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,566 copying build/lib/lm_eval/tasks/global_piqa/completions/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,568 copying build/lib/lm_eval/tasks/global_piqa/completions/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,570 copying build/lib/lm_eval/tasks/global_piqa/completions/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,572 copying build/lib/lm_eval/tasks/global_piqa/completions/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,574 copying build/lib/lm_eval/tasks/global_piqa/completions/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,576 copying build/lib/lm_eval/tasks/global_piqa/completions/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,578 copying build/lib/lm_eval/tasks/global_piqa/completions/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,580 copying build/lib/lm_eval/tasks/global_piqa/completions/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,582 copying build/lib/lm_eval/tasks/global_piqa/completions/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,583 copying build/lib/lm_eval/tasks/global_piqa/completions/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,586 copying build/lib/lm_eval/tasks/global_piqa/completions/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,588 copying build/lib/lm_eval/tasks/global_piqa/completions/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,590 copying build/lib/lm_eval/tasks/global_piqa/completions/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,591 copying build/lib/lm_eval/tasks/global_piqa/completions/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/completions 2026-02-14T10:26:31,594 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unitxt 2026-02-14T10:26:31,595 copying build/lib/lm_eval/tasks/unitxt/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,598 copying build/lib/lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,600 copying build/lib/lm_eval/tasks/unitxt/doc_vqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,602 copying build/lib/lm_eval/tasks/unitxt/argument_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,604 copying build/lib/lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,606 copying build/lib/lm_eval/tasks/unitxt/coedit_gec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,612 copying build/lib/lm_eval/tasks/unitxt/unfair_tos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,613 copying build/lib/lm_eval/tasks/unitxt/ledgar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,615 copying build/lib/lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,619 copying build/lib/lm_eval/tasks/unitxt/unitxt_multimodal -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,621 copying build/lib/lm_eval/tasks/unitxt/ethos_binary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,623 copying build/lib/lm_eval/tasks/unitxt/ag_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,624 copying build/lib/lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,626 copying build/lib/lm_eval/tasks/unitxt/financial_tweets.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,628 copying build/lib/lm_eval/tasks/unitxt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,629 copying build/lib/lm_eval/tasks/unitxt/stsb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,636 copying build/lib/lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,638 copying build/lib/lm_eval/tasks/unitxt/atis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,640 copying build/lib/lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,642 copying build/lib/lm_eval/tasks/unitxt/xsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,644 copying build/lib/lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,645 copying build/lib/lm_eval/tasks/unitxt/unitxt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,647 copying build/lib/lm_eval/tasks/unitxt/banking77.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-02-14T10:26:31,650 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete 2026-02-14T10:26:31,651 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-02-14T10:26:31,652 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-02-14T10:26:31,654 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-02-14T10:26:31,656 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-02-14T10:26:31,658 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete 2026-02-14T10:26:31,660 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-02-14T10:26:31,661 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-02-14T10:26:31,663 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-02-14T10:26:31,664 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-02-14T10:26:31,667 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-02-14T10:26:31,668 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-02-14T10:26:31,669 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-02-14T10:26:31,671 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-02-14T10:26:31,673 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-02-14T10:26:31,674 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-02-14T10:26:31,676 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-02-14T10:26:31,678 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-02-14T10:26:31,682 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-02-14T10:26:31,683 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-02-14T10:26:31,685 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-02-14T10:26:31,687 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-02-14T10:26:31,689 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-02-14T10:26:31,695 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-02-14T10:26:31,698 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-02-14T10:26:31,700 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-02-14T10:26:31,702 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,703 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,705 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,707 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,708 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,710 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,712 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,714 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,716 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,718 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,719 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,721 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-02-14T10:26:31,723 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-02-14T10:26:31,724 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-02-14T10:26:31,727 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-02-14T10:26:31,728 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-02-14T10:26:31,731 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-02-14T10:26:31,732 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-02-14T10:26:31,734 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-02-14T10:26:31,735 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-02-14T10:26:31,739 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,740 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,742 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,743 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,745 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,747 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,749 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,751 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,753 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,755 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,756 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,758 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,760 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,762 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,764 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,766 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,767 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,769 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,771 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,773 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,774 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,776 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,778 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,780 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,782 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,784 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,785 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,787 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,789 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,791 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,793 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,794 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,796 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,798 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,800 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,801 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,803 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,805 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,807 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,809 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,811 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,812 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,814 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,816 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,818 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,819 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,821 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,823 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,825 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,827 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,829 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,830 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,832 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,834 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,836 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,837 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,839 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,841 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,843 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,845 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-02-14T10:26:31,846 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete 2026-02-14T10:26:31,850 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-02-14T10:26:31,851 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-02-14T10:26:31,853 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-02-14T10:26:31,856 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-02-14T10:26:31,858 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-02-14T10:26:31,860 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-02-14T10:26:31,862 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-02-14T10:26:31,864 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-02-14T10:26:31,868 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,869 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,872 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,874 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,876 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,878 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,880 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,882 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,885 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,887 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,889 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,891 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,894 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,896 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,898 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,900 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,903 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,905 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,907 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,909 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,911 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,914 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,916 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,918 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,920 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,923 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,925 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,927 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,929 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,932 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,934 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,936 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,938 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,940 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,943 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,945 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,947 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,949 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,951 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,953 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,955 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,956 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,958 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,960 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,962 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,964 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,966 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,967 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,969 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,971 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,972 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,974 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,975 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,977 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,979 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,981 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,982 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,984 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,986 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,988 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,989 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-02-14T10:26:31,992 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-02-14T10:26:31,993 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-02-14T10:26:31,995 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-02-14T10:26:31,996 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-02-14T10:26:31,998 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-02-14T10:26:31,999 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-02-14T10:26:32,001 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-02-14T10:26:32,003 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-02-14T10:26:32,005 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa2 2026-02-14T10:26:32,006 copying build/lib/lm_eval/tasks/logiqa2/logiqa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-02-14T10:26:32,008 copying build/lib/lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-02-14T10:26:32,010 copying build/lib/lm_eval/tasks/logiqa2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-02-14T10:26:32,012 copying build/lib/lm_eval/tasks/logiqa2/logieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-02-14T10:26:32,014 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue 2026-02-14T10:26:32,016 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/multirc 2026-02-14T10:26:32,017 copying build/lib/lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2026-02-14T10:26:32,019 copying build/lib/lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2026-02-14T10:26:32,021 copying build/lib/lm_eval/tasks/super_glue/multirc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2026-02-14T10:26:32,023 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/rte 2026-02-14T10:26:32,024 copying build/lib/lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte 2026-02-14T10:26:32,026 copying build/lib/lm_eval/tasks/super_glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte 2026-02-14T10:26:32,028 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wic 2026-02-14T10:26:32,029 copying build/lib/lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic 2026-02-14T10:26:32,031 copying build/lib/lm_eval/tasks/super_glue/wic/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic 2026-02-14T10:26:32,032 copying build/lib/lm_eval/tasks/super_glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue 2026-02-14T10:26:32,035 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wsc 2026-02-14T10:26:32,036 copying build/lib/lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-02-14T10:26:32,037 copying build/lib/lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-02-14T10:26:32,040 copying build/lib/lm_eval/tasks/super_glue/wsc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-02-14T10:26:32,041 copying build/lib/lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-02-14T10:26:32,043 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/record 2026-02-14T10:26:32,044 copying build/lib/lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-02-14T10:26:32,046 copying build/lib/lm_eval/tasks/super_glue/record/util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-02-14T10:26:32,048 copying build/lib/lm_eval/tasks/super_glue/record/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-02-14T10:26:32,049 copying build/lib/lm_eval/tasks/super_glue/record/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-02-14T10:26:32,052 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/boolq 2026-02-14T10:26:32,053 copying build/lib/lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2026-02-14T10:26:32,054 copying build/lib/lm_eval/tasks/super_glue/boolq/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2026-02-14T10:26:32,056 copying build/lib/lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2026-02-14T10:26:32,059 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/copa 2026-02-14T10:26:32,060 copying build/lib/lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2026-02-14T10:26:32,061 copying build/lib/lm_eval/tasks/super_glue/copa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2026-02-14T10:26:32,063 copying build/lib/lm_eval/tasks/super_glue/copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2026-02-14T10:26:32,065 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/cb 2026-02-14T10:26:32,066 copying build/lib/lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-02-14T10:26:32,068 copying build/lib/lm_eval/tasks/super_glue/cb/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-02-14T10:26:32,070 copying build/lib/lm_eval/tasks/super_glue/cb/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-02-14T10:26:32,071 copying build/lib/lm_eval/tasks/super_glue/cb/aggregate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-02-14T10:26:32,074 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lingoly 2026-02-14T10:26:32,075 copying build/lib/lm_eval/tasks/lingoly/lingoly_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-02-14T10:26:32,077 copying build/lib/lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-02-14T10:26:32,078 copying build/lib/lm_eval/tasks/lingoly/script.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-02-14T10:26:32,080 copying build/lib/lm_eval/tasks/lingoly/lingoly_context.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-02-14T10:26:32,082 copying build/lib/lm_eval/tasks/lingoly/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-02-14T10:26:32,084 copying build/lib/lm_eval/tasks/lingoly/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-02-14T10:26:32,086 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pubmedqa 2026-02-14T10:26:32,087 copying build/lib/lm_eval/tasks/pubmedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2026-02-14T10:26:32,089 copying build/lib/lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2026-02-14T10:26:32,090 copying build/lib/lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2026-02-14T10:26:32,093 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/meddialog 2026-02-14T10:26:32,094 copying build/lib/lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-02-14T10:26:32,096 copying build/lib/lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-02-14T10:26:32,097 copying build/lib/lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-02-14T10:26:32,099 copying build/lib/lm_eval/tasks/meddialog/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-02-14T10:26:32,101 copying build/lib/lm_eval/tasks/meddialog/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-02-14T10:26:32,103 copying build/lib/lm_eval/tasks/meddialog/meddialog_qsumm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-02-14T10:26:32,104 copying build/lib/lm_eval/tasks/meddialog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-02-14T10:26:32,107 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squadv2 2026-02-14T10:26:32,108 copying build/lib/lm_eval/tasks/squadv2/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2026-02-14T10:26:32,110 copying build/lib/lm_eval/tasks/squadv2/squadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2026-02-14T10:26:32,112 copying build/lib/lm_eval/tasks/squadv2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2026-02-14T10:26:32,115 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_ethics 2026-02-14T10:26:32,116 copying build/lib/lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-02-14T10:26:32,117 copying build/lib/lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-02-14T10:26:32,119 copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-02-14T10:26:32,121 copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-02-14T10:26:32,123 copying build/lib/lm_eval/tasks/hendrycks_ethics/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-02-14T10:26:32,124 copying build/lib/lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-02-14T10:26:32,126 copying build/lib/lm_eval/tasks/hendrycks_ethics/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-02-14T10:26:32,128 copying build/lib/lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-02-14T10:26:32,131 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cmmlu 2026-02-14T10:26:32,132 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,134 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,136 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,138 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,140 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,142 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,143 copying build/lib/lm_eval/tasks/cmmlu/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,145 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,147 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,148 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,150 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,152 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,154 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,155 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,157 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,159 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,161 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,162 copying build/lib/lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,164 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,166 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,168 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,170 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,171 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,173 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,175 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,177 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,178 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,180 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,182 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,184 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,186 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,188 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,189 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,191 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,193 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,194 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,196 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,197 copying build/lib/lm_eval/tasks/cmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,199 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,201 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,203 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,205 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,206 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,208 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,210 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,212 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,213 copying build/lib/lm_eval/tasks/cmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,215 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,217 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,219 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,221 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,222 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,224 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,226 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,228 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,230 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,231 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,233 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,235 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,237 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,238 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,240 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,242 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,244 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,245 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,247 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,248 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,250 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,252 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,253 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,255 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-02-14T10:26:32,257 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli 2026-02-14T10:26:32,259 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate 2026-02-14T10:26:32,261 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,262 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,264 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,266 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,267 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,269 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,271 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,273 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,274 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,276 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,278 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,280 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,282 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,283 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,285 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,287 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,289 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,290 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,292 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,294 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-02-14T10:26:32,296 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,297 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,299 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,301 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,303 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,305 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,306 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,308 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,310 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,312 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,314 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,316 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,317 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,319 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,321 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,323 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,324 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,326 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,328 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,330 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-02-14T10:26:32,332 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,333 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,335 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,337 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,338 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,340 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,342 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,344 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,346 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,347 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,349 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,351 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,353 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,355 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,356 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,358 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,360 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,362 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,364 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,365 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-02-14T10:26:32,368 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,369 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,371 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,373 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,374 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,376 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,378 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,380 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,382 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,384 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,386 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,388 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,389 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,391 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,393 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,395 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,397 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,399 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,401 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,403 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-02-14T10:26:32,404 copying build/lib/lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate 2026-02-14T10:26:32,407 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,408 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,410 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,411 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,413 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,415 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,417 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,418 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,420 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,422 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,423 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,425 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,427 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,429 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,431 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,433 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,435 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,437 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,439 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,441 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-02-14T10:26:32,443 copying build/lib/lm_eval/tasks/afrixnli/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2026-02-14T10:26:32,446 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt 2026-02-14T10:26:32,447 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,449 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,450 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,452 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,454 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,456 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,457 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,459 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,461 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,463 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,464 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,466 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,468 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,470 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,472 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,473 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,475 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,477 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,479 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,481 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-02-14T10:26:32,483 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,485 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,487 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,489 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,490 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,492 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,494 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,496 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,498 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,500 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,501 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,503 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,505 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,507 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,509 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,511 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,513 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,515 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,517 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,519 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,521 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-02-14T10:26:32,523 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,524 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,526 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,528 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,531 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,532 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,534 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,536 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,538 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,539 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,541 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,543 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,545 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,546 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,548 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,550 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,552 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,554 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,556 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,558 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,560 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-02-14T10:26:32,562 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt 2026-02-14T10:26:32,564 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,565 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,567 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,569 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,571 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,573 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,574 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,576 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,578 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,580 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,581 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,583 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,585 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,587 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,588 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,591 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,592 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,594 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,596 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,598 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-02-14T10:26:32,600 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,601 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,603 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,605 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,607 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,609 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,611 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,613 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,614 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,616 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,618 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,620 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,621 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,623 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,625 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,627 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,628 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,630 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,632 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,634 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,636 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-02-14T10:26:32,639 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct 2026-02-14T10:26:32,640 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,642 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,644 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,645 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,647 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,649 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,650 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,653 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,655 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,656 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,658 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,660 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,661 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,663 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,665 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,667 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,669 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,671 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,673 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,675 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,677 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-02-14T10:26:32,680 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,681 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,684 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,686 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,687 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,690 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,692 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,694 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,696 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,699 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,701 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,703 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,706 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,708 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,710 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,712 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,714 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,716 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,719 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,721 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,723 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-02-14T10:26:32,726 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,728 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,730 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,733 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,735 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,738 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,740 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,742 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,744 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,747 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,749 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,751 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,753 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,755 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,758 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,760 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,762 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,764 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,767 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,769 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,771 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-02-14T10:26:32,774 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,775 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,778 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,780 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,782 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,785 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,788 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,790 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,792 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,794 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,797 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,799 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,801 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,803 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,805 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,808 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,810 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,812 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,814 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,816 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,818 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-02-14T10:26:32,821 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,822 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,824 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,827 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,829 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,831 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,833 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,835 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,837 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,840 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,842 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,844 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,846 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,848 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,850 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,852 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,854 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,856 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,858 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,861 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,863 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-02-14T10:26:32,865 copying build/lib/lm_eval/tasks/afrixnli/direct/afrixnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct 2026-02-14T10:26:32,867 copying build/lib/lm_eval/tasks/afrixnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2026-02-14T10:26:32,869 copying build/lib/lm_eval/tasks/afrixnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2026-02-14T10:26:32,872 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/siqa 2026-02-14T10:26:32,874 copying build/lib/lm_eval/tasks/siqa/siqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa 2026-02-14T10:26:32,876 copying build/lib/lm_eval/tasks/siqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa 2026-02-14T10:26:32,879 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/egyhellaswag 2026-02-14T10:26:32,880 copying build/lib/lm_eval/tasks/egyhellaswag/egyhellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2026-02-14T10:26:32,883 copying build/lib/lm_eval/tasks/egyhellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2026-02-14T10:26:32,885 copying build/lib/lm_eval/tasks/egyhellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2026-02-14T10:26:32,887 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm8k_platinum 2026-02-14T10:26:32,889 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-02-14T10:26:32,891 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-02-14T10:26:32,894 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-02-14T10:26:32,896 copying build/lib/lm_eval/tasks/gsm8k_platinum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-02-14T10:26:32,898 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-02-14T10:26:32,901 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-02-14T10:26:32,904 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aexams 2026-02-14T10:26:32,905 copying build/lib/lm_eval/tasks/aexams/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-02-14T10:26:32,907 copying build/lib/lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-02-14T10:26:32,909 copying build/lib/lm_eval/tasks/aexams/aexams_Social.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-02-14T10:26:32,911 copying build/lib/lm_eval/tasks/aexams/aexams_Science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-02-14T10:26:32,913 copying build/lib/lm_eval/tasks/aexams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-02-14T10:26:32,915 copying build/lib/lm_eval/tasks/aexams/aexams_Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-02-14T10:26:32,917 copying build/lib/lm_eval/tasks/aexams/aexams_Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-02-14T10:26:32,919 copying build/lib/lm_eval/tasks/aexams/_aexams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-02-14T10:26:32,922 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toxigen 2026-02-14T10:26:32,924 copying build/lib/lm_eval/tasks/toxigen/toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2026-02-14T10:26:32,926 copying build/lib/lm_eval/tasks/toxigen/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2026-02-14T10:26:32,928 copying build/lib/lm_eval/tasks/toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2026-02-14T10:26:32,934 creating build/bdist.linux-armv7l/wheel/lm_eval/decontamination 2026-02-14T10:26:32,935 copying build/lib/lm_eval/decontamination/janitor.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-02-14T10:26:32,938 copying build/lib/lm_eval/decontamination/archiver.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-02-14T10:26:32,941 copying build/lib/lm_eval/decontamination/decontaminate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-02-14T10:26:32,944 copying build/lib/lm_eval/decontamination/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-02-14T10:26:32,947 creating build/bdist.linux-armv7l/wheel/lm_eval/models 2026-02-14T10:26:32,948 copying build/lib/lm_eval/models/hf_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,951 copying build/lib/lm_eval/models/winml.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,954 copying build/lib/lm_eval/models/mistral3.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,957 copying build/lib/lm_eval/models/nemo_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,960 copying build/lib/lm_eval/models/huggingface.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,964 copying build/lib/lm_eval/models/anthropic_llms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,966 copying build/lib/lm_eval/models/gguf.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,969 copying build/lib/lm_eval/models/sglang_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,971 copying build/lib/lm_eval/models/dummy.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,973 copying build/lib/lm_eval/models/vllm_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,976 copying build/lib/lm_eval/models/mamba_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,978 copying build/lib/lm_eval/models/hf_steered.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,981 copying build/lib/lm_eval/models/optimum_ipex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,983 copying build/lib/lm_eval/models/ibm_watsonx_ai.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,985 copying build/lib/lm_eval/models/openai_completions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,988 copying build/lib/lm_eval/models/utils_hf.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,990 copying build/lib/lm_eval/models/api_models.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,993 copying build/lib/lm_eval/models/vllm_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,996 copying build/lib/lm_eval/models/textsynth.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:32,998 copying build/lib/lm_eval/models/neuron_optimum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:33,001 copying build/lib/lm_eval/models/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:33,004 copying build/lib/lm_eval/models/sglang_generate_API.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:33,005 copying build/lib/lm_eval/models/hf_audiolm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:33,008 copying build/lib/lm_eval/models/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:33,010 copying build/lib/lm_eval/models/optimum_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-02-14T10:26:33,012 creating build/bdist.linux-armv7l/wheel/lm_eval/caching 2026-02-14T10:26:33,013 copying build/lib/lm_eval/caching/cache.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching 2026-02-14T10:26:33,015 copying build/lib/lm_eval/caching/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching 2026-02-14T10:26:33,017 creating build/bdist.linux-armv7l/wheel/lm_eval/_cli 2026-02-14T10:26:33,018 copying build/lib/lm_eval/_cli/run.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-02-14T10:26:33,021 copying build/lib/lm_eval/_cli/subcommand.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-02-14T10:26:33,022 copying build/lib/lm_eval/_cli/validate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-02-14T10:26:33,024 copying build/lib/lm_eval/_cli/ls.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-02-14T10:26:33,026 copying build/lib/lm_eval/_cli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-02-14T10:26:33,028 copying build/lib/lm_eval/_cli/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-02-14T10:26:33,030 copying build/lib/lm_eval/_cli/harness.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-02-14T10:26:33,032 copying build/lib/lm_eval/__main__.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-02-14T10:26:33,034 copying build/lib/lm_eval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-02-14T10:26:33,037 creating build/bdist.linux-armv7l/wheel/lm_eval/api 2026-02-14T10:26:33,038 copying build/lib/lm_eval/api/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-02-14T10:26:33,041 copying build/lib/lm_eval/api/group.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-02-14T10:26:33,043 copying build/lib/lm_eval/api/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-02-14T10:26:33,046 copying build/lib/lm_eval/api/samplers.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-02-14T10:26:33,047 copying build/lib/lm_eval/api/filter.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-02-14T10:26:33,049 copying build/lib/lm_eval/api/registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-02-14T10:26:33,052 copying build/lib/lm_eval/api/instance.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-02-14T10:26:33,054 copying build/lib/lm_eval/api/model.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-02-14T10:26:33,056 copying build/lib/lm_eval/api/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-02-14T10:26:33,058 copying build/lib/lm_eval/api/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-02-14T10:26:33,059 copying build/lib/lm_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-02-14T10:26:33,062 creating build/bdist.linux-armv7l/wheel/lm_eval/config 2026-02-14T10:26:33,063 copying build/lib/lm_eval/config/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/config 2026-02-14T10:26:33,065 copying build/lib/lm_eval/config/evaluate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/config 2026-02-14T10:26:33,068 copying build/lib/lm_eval/config/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/config 2026-02-14T10:26:33,073 running install_egg_info 2026-02-14T10:26:33,079 Copying lm_eval.egg-info to build/bdist.linux-armv7l/wheel/./lm_eval-0.4.11-py3.11.egg-info 2026-02-14T10:26:33,104 running install_scripts 2026-02-14T10:26:33,118 creating build/bdist.linux-armv7l/wheel/lm_eval-0.4.11.dist-info/WHEEL 2026-02-14T10:26:33,121 creating '/tmp/pip-wheel-wnlla9wb/.tmp-gq_f4vqs/lm_eval-0.4.11-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2026-02-14T10:26:33,124 adding 'lm_eval/__init__.py' 2026-02-14T10:26:33,125 adding 'lm_eval/__main__.py' 2026-02-14T10:26:33,127 adding 'lm_eval/defaults.py' 2026-02-14T10:26:33,132 adding 'lm_eval/evaluator.py' 2026-02-14T10:26:33,136 adding 'lm_eval/evaluator_utils.py' 2026-02-14T10:26:33,140 adding 'lm_eval/utils.py' 2026-02-14T10:26:33,143 adding 'lm_eval/_cli/__init__.py' 2026-02-14T10:26:33,144 adding 'lm_eval/_cli/harness.py' 2026-02-14T10:26:33,146 adding 'lm_eval/_cli/ls.py' 2026-02-14T10:26:33,149 adding 'lm_eval/_cli/run.py' 2026-02-14T10:26:33,151 adding 'lm_eval/_cli/subcommand.py' 2026-02-14T10:26:33,153 adding 'lm_eval/_cli/utils.py' 2026-02-14T10:26:33,155 adding 'lm_eval/_cli/validate.py' 2026-02-14T10:26:33,161 adding 'lm_eval/api/__init__.py' 2026-02-14T10:26:33,163 adding 'lm_eval/api/filter.py' 2026-02-14T10:26:33,165 adding 'lm_eval/api/group.py' 2026-02-14T10:26:33,166 adding 'lm_eval/api/instance.py' 2026-02-14T10:26:33,169 adding 'lm_eval/api/metrics.py' 2026-02-14T10:26:33,173 adding 'lm_eval/api/model.py' 2026-02-14T10:26:33,177 adding 'lm_eval/api/registry.py' 2026-02-14T10:26:33,179 adding 'lm_eval/api/samplers.py' 2026-02-14T10:26:33,187 adding 'lm_eval/api/task.py' 2026-02-14T10:26:33,190 adding 'lm_eval/api/utils.py' 2026-02-14T10:26:33,192 adding 'lm_eval/caching/__init__.py' 2026-02-14T10:26:33,193 adding 'lm_eval/caching/cache.py' 2026-02-14T10:26:33,196 adding 'lm_eval/config/__init__.py' 2026-02-14T10:26:33,198 adding 'lm_eval/config/evaluate_config.py' 2026-02-14T10:26:33,200 adding 'lm_eval/config/task.py' 2026-02-14T10:26:33,203 adding 'lm_eval/decontamination/__init__.py' 2026-02-14T10:26:33,205 adding 'lm_eval/decontamination/archiver.py' 2026-02-14T10:26:33,207 adding 'lm_eval/decontamination/decontaminate.py' 2026-02-14T10:26:33,209 adding 'lm_eval/decontamination/janitor.py' 2026-02-14T10:26:33,212 adding 'lm_eval/filters/__init__.py' 2026-02-14T10:26:33,213 adding 'lm_eval/filters/custom.py' 2026-02-14T10:26:33,215 adding 'lm_eval/filters/decontamination.py' 2026-02-14T10:26:33,218 adding 'lm_eval/filters/extraction.py' 2026-02-14T10:26:33,219 adding 'lm_eval/filters/selection.py' 2026-02-14T10:26:33,221 adding 'lm_eval/filters/transformation.py' 2026-02-14T10:26:33,223 adding 'lm_eval/loggers/__init__.py' 2026-02-14T10:26:33,227 adding 'lm_eval/loggers/evaluation_tracker.py' 2026-02-14T10:26:33,229 adding 'lm_eval/loggers/utils.py' 2026-02-14T10:26:33,232 adding 'lm_eval/loggers/wandb_logger.py' 2026-02-14T10:26:33,234 adding 'lm_eval/models/__init__.py' 2026-02-14T10:26:33,237 adding 'lm_eval/models/anthropic_llms.py' 2026-02-14T10:26:33,241 adding 'lm_eval/models/api_models.py' 2026-02-14T10:26:33,243 adding 'lm_eval/models/dummy.py' 2026-02-14T10:26:33,246 adding 'lm_eval/models/gguf.py' 2026-02-14T10:26:33,248 adding 'lm_eval/models/hf_audiolm.py' 2026-02-14T10:26:33,250 adding 'lm_eval/models/hf_steered.py' 2026-02-14T10:26:33,255 adding 'lm_eval/models/hf_vlms.py' 2026-02-14T10:26:33,264 adding 'lm_eval/models/huggingface.py' 2026-02-14T10:26:33,267 adding 'lm_eval/models/ibm_watsonx_ai.py' 2026-02-14T10:26:33,269 adding 'lm_eval/models/mamba_lm.py' 2026-02-14T10:26:33,271 adding 'lm_eval/models/mistral3.py' 2026-02-14T10:26:33,274 adding 'lm_eval/models/nemo_lm.py' 2026-02-14T10:26:33,278 adding 'lm_eval/models/neuron_optimum.py' 2026-02-14T10:26:33,281 adding 'lm_eval/models/openai_completions.py' 2026-02-14T10:26:33,283 adding 'lm_eval/models/optimum_ipex.py' 2026-02-14T10:26:33,285 adding 'lm_eval/models/optimum_lm.py' 2026-02-14T10:26:33,288 adding 'lm_eval/models/sglang_causallms.py' 2026-02-14T10:26:33,290 adding 'lm_eval/models/sglang_generate_API.py' 2026-02-14T10:26:33,292 adding 'lm_eval/models/textsynth.py' 2026-02-14T10:26:33,297 adding 'lm_eval/models/utils.py' 2026-02-14T10:26:33,299 adding 'lm_eval/models/utils_hf.py' 2026-02-14T10:26:33,304 adding 'lm_eval/models/vllm_causallms.py' 2026-02-14T10:26:33,307 adding 'lm_eval/models/vllm_vlms.py' 2026-02-14T10:26:33,311 adding 'lm_eval/models/winml.py' 2026-02-14T10:26:33,314 adding 'lm_eval/prompts/__init__.py' 2026-02-14T10:26:33,324 adding 'lm_eval/tasks/README.md' 2026-02-14T10:26:33,330 adding 'lm_eval/tasks/__init__.py' 2026-02-14T10:26:33,332 adding 'lm_eval/tasks/aclue/README.md' 2026-02-14T10:26:33,334 adding 'lm_eval/tasks/aclue/_aclue.yaml' 2026-02-14T10:26:33,336 adding 'lm_eval/tasks/aclue/_default_template_yaml' 2026-02-14T10:26:33,338 adding 'lm_eval/tasks/aclue/_generate_configs.py' 2026-02-14T10:26:33,339 adding 'lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml' 2026-02-14T10:26:33,341 adding 'lm_eval/tasks/aclue/aclue_ancient_literature.yaml' 2026-02-14T10:26:33,342 adding 'lm_eval/tasks/aclue/aclue_ancient_medical.yaml' 2026-02-14T10:26:33,344 adding 'lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml' 2026-02-14T10:26:33,346 adding 'lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml' 2026-02-14T10:26:33,347 adding 'lm_eval/tasks/aclue/aclue_couplet_prediction.yaml' 2026-02-14T10:26:33,349 adding 'lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml' 2026-02-14T10:26:33,350 adding 'lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml' 2026-02-14T10:26:33,352 adding 'lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml' 2026-02-14T10:26:33,354 adding 'lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml' 2026-02-14T10:26:33,356 adding 'lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml' 2026-02-14T10:26:33,357 adding 'lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml' 2026-02-14T10:26:33,359 adding 'lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml' 2026-02-14T10:26:33,360 adding 'lm_eval/tasks/aclue/aclue_reading_comprehension.yaml' 2026-02-14T10:26:33,362 adding 'lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml' 2026-02-14T10:26:33,365 adding 'lm_eval/tasks/acpbench/README.md' 2026-02-14T10:26:33,367 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml' 2026-02-14T10:26:33,369 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml' 2026-02-14T10:26:33,371 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml' 2026-02-14T10:26:33,372 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml' 2026-02-14T10:26:33,374 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml' 2026-02-14T10:26:33,376 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml' 2026-02-14T10:26:33,378 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml' 2026-02-14T10:26:33,380 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml' 2026-02-14T10:26:33,382 adding 'lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot' 2026-02-14T10:26:33,384 adding 'lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark' 2026-02-14T10:26:33,389 adding 'lm_eval/tasks/acpbench/gen_2shot/acp_utils.py' 2026-02-14T10:26:33,391 adding 'lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml' 2026-02-14T10:26:33,392 adding 'lm_eval/tasks/acpbench/gen_2shot/app.yaml' 2026-02-14T10:26:33,394 adding 'lm_eval/tasks/acpbench/gen_2shot/just.yaml' 2026-02-14T10:26:33,396 adding 'lm_eval/tasks/acpbench/gen_2shot/land.yaml' 2026-02-14T10:26:33,398 adding 'lm_eval/tasks/acpbench/gen_2shot/next_act.yaml' 2026-02-14T10:26:33,400 adding 'lm_eval/tasks/acpbench/gen_2shot/prog.yaml' 2026-02-14T10:26:33,402 adding 'lm_eval/tasks/acpbench/gen_2shot/reach.yaml' 2026-02-14T10:26:33,403 adding 'lm_eval/tasks/acpbench/gen_2shot/val.yaml' 2026-02-14T10:26:33,406 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot' 2026-02-14T10:26:33,407 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark' 2026-02-14T10:26:33,412 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py' 2026-02-14T10:26:33,415 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml' 2026-02-14T10:26:33,417 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml' 2026-02-14T10:26:33,420 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml' 2026-02-14T10:26:33,422 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml' 2026-02-14T10:26:33,424 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml' 2026-02-14T10:26:33,427 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml' 2026-02-14T10:26:33,429 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml' 2026-02-14T10:26:33,432 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml' 2026-02-14T10:26:33,434 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml' 2026-02-14T10:26:33,436 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml' 2026-02-14T10:26:33,438 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml' 2026-02-14T10:26:33,440 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml' 2026-02-14T10:26:33,441 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml' 2026-02-14T10:26:33,443 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml' 2026-02-14T10:26:33,445 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml' 2026-02-14T10:26:33,447 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml' 2026-02-14T10:26:33,449 adding 'lm_eval/tasks/aexams/README.md' 2026-02-14T10:26:33,451 adding 'lm_eval/tasks/aexams/_aexams.yaml' 2026-02-14T10:26:33,453 adding 'lm_eval/tasks/aexams/_default_template_yaml' 2026-02-14T10:26:33,454 adding 'lm_eval/tasks/aexams/aexams_Biology.yaml' 2026-02-14T10:26:33,456 adding 'lm_eval/tasks/aexams/aexams_IslamicStudies.yaml' 2026-02-14T10:26:33,457 adding 'lm_eval/tasks/aexams/aexams_Physics.yaml' 2026-02-14T10:26:33,458 adding 'lm_eval/tasks/aexams/aexams_Science.yaml' 2026-02-14T10:26:33,459 adding 'lm_eval/tasks/aexams/aexams_Social.yaml' 2026-02-14T10:26:33,461 adding 'lm_eval/tasks/afrimgsm/README.md' 2026-02-14T10:26:33,463 adding 'lm_eval/tasks/afrimgsm/gen_utils.py' 2026-02-14T10:26:33,464 adding 'lm_eval/tasks/afrimgsm/gen_yaml.sh' 2026-02-14T10:26:33,465 adding 'lm_eval/tasks/afrimgsm/run.sh' 2026-02-14T10:26:33,467 adding 'lm_eval/tasks/afrimgsm/utils.py' 2026-02-14T10:26:33,469 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml' 2026-02-14T10:26:33,471 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml' 2026-02-14T10:26:33,472 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml' 2026-02-14T10:26:33,473 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml' 2026-02-14T10:26:33,474 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml' 2026-02-14T10:26:33,475 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml' 2026-02-14T10:26:33,477 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml' 2026-02-14T10:26:33,478 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml' 2026-02-14T10:26:33,479 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml' 2026-02-14T10:26:33,480 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml' 2026-02-14T10:26:33,481 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml' 2026-02-14T10:26:33,483 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml' 2026-02-14T10:26:33,484 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml' 2026-02-14T10:26:33,485 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml' 2026-02-14T10:26:33,486 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml' 2026-02-14T10:26:33,487 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml' 2026-02-14T10:26:33,488 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml' 2026-02-14T10:26:33,489 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml' 2026-02-14T10:26:33,491 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml' 2026-02-14T10:26:33,492 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml' 2026-02-14T10:26:33,493 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml' 2026-02-14T10:26:33,495 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml' 2026-02-14T10:26:33,496 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml' 2026-02-14T10:26:33,497 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml' 2026-02-14T10:26:33,499 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml' 2026-02-14T10:26:33,500 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml' 2026-02-14T10:26:33,501 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml' 2026-02-14T10:26:33,502 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml' 2026-02-14T10:26:33,504 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml' 2026-02-14T10:26:33,505 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml' 2026-02-14T10:26:33,506 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml' 2026-02-14T10:26:33,507 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml' 2026-02-14T10:26:33,509 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml' 2026-02-14T10:26:33,510 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml' 2026-02-14T10:26:33,511 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml' 2026-02-14T10:26:33,512 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml' 2026-02-14T10:26:33,513 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml' 2026-02-14T10:26:33,514 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml' 2026-02-14T10:26:33,516 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml' 2026-02-14T10:26:33,517 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml' 2026-02-14T10:26:33,518 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml' 2026-02-14T10:26:33,520 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml' 2026-02-14T10:26:33,521 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml' 2026-02-14T10:26:33,522 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml' 2026-02-14T10:26:33,523 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml' 2026-02-14T10:26:33,524 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml' 2026-02-14T10:26:33,526 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml' 2026-02-14T10:26:33,527 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml' 2026-02-14T10:26:33,528 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml' 2026-02-14T10:26:33,529 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml' 2026-02-14T10:26:33,530 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml' 2026-02-14T10:26:33,532 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml' 2026-02-14T10:26:33,533 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml' 2026-02-14T10:26:33,534 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml' 2026-02-14T10:26:33,535 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml' 2026-02-14T10:26:33,536 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml' 2026-02-14T10:26:33,537 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml' 2026-02-14T10:26:33,538 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml' 2026-02-14T10:26:33,539 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml' 2026-02-14T10:26:33,540 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml' 2026-02-14T10:26:33,542 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml' 2026-02-14T10:26:33,543 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml' 2026-02-14T10:26:33,544 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml' 2026-02-14T10:26:33,546 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml' 2026-02-14T10:26:33,547 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml' 2026-02-14T10:26:33,548 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml' 2026-02-14T10:26:33,549 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml' 2026-02-14T10:26:33,551 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml' 2026-02-14T10:26:33,552 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml' 2026-02-14T10:26:33,553 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml' 2026-02-14T10:26:33,554 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml' 2026-02-14T10:26:33,555 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml' 2026-02-14T10:26:33,556 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml' 2026-02-14T10:26:33,557 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml' 2026-02-14T10:26:33,559 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml' 2026-02-14T10:26:33,560 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml' 2026-02-14T10:26:33,561 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml' 2026-02-14T10:26:33,562 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml' 2026-02-14T10:26:33,563 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml' 2026-02-14T10:26:33,565 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml' 2026-02-14T10:26:33,566 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml' 2026-02-14T10:26:33,568 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml' 2026-02-14T10:26:33,569 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml' 2026-02-14T10:26:33,570 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml' 2026-02-14T10:26:33,572 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml' 2026-02-14T10:26:33,573 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml' 2026-02-14T10:26:33,574 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml' 2026-02-14T10:26:33,575 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml' 2026-02-14T10:26:33,576 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml' 2026-02-14T10:26:33,578 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml' 2026-02-14T10:26:33,579 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml' 2026-02-14T10:26:33,580 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml' 2026-02-14T10:26:33,581 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml' 2026-02-14T10:26:33,583 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml' 2026-02-14T10:26:33,584 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml' 2026-02-14T10:26:33,585 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml' 2026-02-14T10:26:33,586 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml' 2026-02-14T10:26:33,588 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml' 2026-02-14T10:26:33,589 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml' 2026-02-14T10:26:33,590 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml' 2026-02-14T10:26:33,591 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml' 2026-02-14T10:26:33,593 adding 'lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml' 2026-02-14T10:26:33,595 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml' 2026-02-14T10:26:33,596 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml' 2026-02-14T10:26:33,597 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml' 2026-02-14T10:26:33,598 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml' 2026-02-14T10:26:33,599 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml' 2026-02-14T10:26:33,600 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml' 2026-02-14T10:26:33,602 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml' 2026-02-14T10:26:33,603 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml' 2026-02-14T10:26:33,604 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml' 2026-02-14T10:26:33,605 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml' 2026-02-14T10:26:33,606 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml' 2026-02-14T10:26:33,607 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml' 2026-02-14T10:26:33,608 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml' 2026-02-14T10:26:33,610 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml' 2026-02-14T10:26:33,611 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml' 2026-02-14T10:26:33,612 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml' 2026-02-14T10:26:33,613 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml' 2026-02-14T10:26:33,614 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml' 2026-02-14T10:26:33,616 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml' 2026-02-14T10:26:33,617 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml' 2026-02-14T10:26:33,619 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml' 2026-02-14T10:26:33,620 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml' 2026-02-14T10:26:33,621 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml' 2026-02-14T10:26:33,622 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml' 2026-02-14T10:26:33,623 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml' 2026-02-14T10:26:33,624 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml' 2026-02-14T10:26:33,626 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml' 2026-02-14T10:26:33,627 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml' 2026-02-14T10:26:33,628 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml' 2026-02-14T10:26:33,629 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml' 2026-02-14T10:26:33,630 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml' 2026-02-14T10:26:33,631 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml' 2026-02-14T10:26:33,633 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml' 2026-02-14T10:26:33,634 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml' 2026-02-14T10:26:33,635 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml' 2026-02-14T10:26:33,637 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml' 2026-02-14T10:26:33,638 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml' 2026-02-14T10:26:33,639 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml' 2026-02-14T10:26:33,640 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml' 2026-02-14T10:26:33,641 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml' 2026-02-14T10:26:33,643 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml' 2026-02-14T10:26:33,644 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml' 2026-02-14T10:26:33,646 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml' 2026-02-14T10:26:33,647 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml' 2026-02-14T10:26:33,648 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml' 2026-02-14T10:26:33,649 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml' 2026-02-14T10:26:33,650 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml' 2026-02-14T10:26:33,651 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml' 2026-02-14T10:26:33,652 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml' 2026-02-14T10:26:33,654 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml' 2026-02-14T10:26:33,655 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml' 2026-02-14T10:26:33,656 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml' 2026-02-14T10:26:33,657 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml' 2026-02-14T10:26:33,658 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml' 2026-02-14T10:26:33,659 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml' 2026-02-14T10:26:33,661 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml' 2026-02-14T10:26:33,662 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml' 2026-02-14T10:26:33,663 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml' 2026-02-14T10:26:33,664 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml' 2026-02-14T10:26:33,666 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml' 2026-02-14T10:26:33,668 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml' 2026-02-14T10:26:33,669 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml' 2026-02-14T10:26:33,670 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml' 2026-02-14T10:26:33,671 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml' 2026-02-14T10:26:33,673 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml' 2026-02-14T10:26:33,674 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml' 2026-02-14T10:26:33,675 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml' 2026-02-14T10:26:33,677 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml' 2026-02-14T10:26:33,678 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml' 2026-02-14T10:26:33,679 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml' 2026-02-14T10:26:33,681 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml' 2026-02-14T10:26:33,682 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml' 2026-02-14T10:26:33,683 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml' 2026-02-14T10:26:33,685 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml' 2026-02-14T10:26:33,686 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml' 2026-02-14T10:26:33,687 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml' 2026-02-14T10:26:33,689 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml' 2026-02-14T10:26:33,690 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml' 2026-02-14T10:26:33,691 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml' 2026-02-14T10:26:33,693 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml' 2026-02-14T10:26:33,695 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml' 2026-02-14T10:26:33,696 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml' 2026-02-14T10:26:33,697 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml' 2026-02-14T10:26:33,699 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml' 2026-02-14T10:26:33,700 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml' 2026-02-14T10:26:33,701 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml' 2026-02-14T10:26:33,702 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml' 2026-02-14T10:26:33,703 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml' 2026-02-14T10:26:33,704 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml' 2026-02-14T10:26:33,706 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml' 2026-02-14T10:26:33,707 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml' 2026-02-14T10:26:33,708 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml' 2026-02-14T10:26:33,709 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml' 2026-02-14T10:26:33,710 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml' 2026-02-14T10:26:33,712 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml' 2026-02-14T10:26:33,713 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml' 2026-02-14T10:26:33,714 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml' 2026-02-14T10:26:33,715 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml' 2026-02-14T10:26:33,716 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml' 2026-02-14T10:26:33,718 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml' 2026-02-14T10:26:33,720 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml' 2026-02-14T10:26:33,721 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml' 2026-02-14T10:26:33,722 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml' 2026-02-14T10:26:33,724 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml' 2026-02-14T10:26:33,725 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml' 2026-02-14T10:26:33,726 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml' 2026-02-14T10:26:33,727 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml' 2026-02-14T10:26:33,728 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml' 2026-02-14T10:26:33,730 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml' 2026-02-14T10:26:33,731 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml' 2026-02-14T10:26:33,732 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml' 2026-02-14T10:26:33,733 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml' 2026-02-14T10:26:33,734 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml' 2026-02-14T10:26:33,736 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml' 2026-02-14T10:26:33,737 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml' 2026-02-14T10:26:33,738 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml' 2026-02-14T10:26:33,739 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml' 2026-02-14T10:26:33,741 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml' 2026-02-14T10:26:33,742 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml' 2026-02-14T10:26:33,744 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml' 2026-02-14T10:26:33,745 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml' 2026-02-14T10:26:33,746 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml' 2026-02-14T10:26:33,747 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml' 2026-02-14T10:26:33,748 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml' 2026-02-14T10:26:33,749 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml' 2026-02-14T10:26:33,751 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml' 2026-02-14T10:26:33,752 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml' 2026-02-14T10:26:33,753 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml' 2026-02-14T10:26:33,754 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml' 2026-02-14T10:26:33,755 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml' 2026-02-14T10:26:33,757 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml' 2026-02-14T10:26:33,758 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml' 2026-02-14T10:26:33,759 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml' 2026-02-14T10:26:33,760 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml' 2026-02-14T10:26:33,761 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml' 2026-02-14T10:26:33,762 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml' 2026-02-14T10:26:33,764 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml' 2026-02-14T10:26:33,765 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml' 2026-02-14T10:26:33,767 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml' 2026-02-14T10:26:33,768 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml' 2026-02-14T10:26:33,769 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml' 2026-02-14T10:26:33,770 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml' 2026-02-14T10:26:33,771 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml' 2026-02-14T10:26:33,772 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml' 2026-02-14T10:26:33,774 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml' 2026-02-14T10:26:33,775 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml' 2026-02-14T10:26:33,776 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml' 2026-02-14T10:26:33,777 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml' 2026-02-14T10:26:33,778 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml' 2026-02-14T10:26:33,779 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml' 2026-02-14T10:26:33,781 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml' 2026-02-14T10:26:33,782 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml' 2026-02-14T10:26:33,783 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml' 2026-02-14T10:26:33,784 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml' 2026-02-14T10:26:33,785 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml' 2026-02-14T10:26:33,787 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml' 2026-02-14T10:26:33,788 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml' 2026-02-14T10:26:33,790 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml' 2026-02-14T10:26:33,791 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml' 2026-02-14T10:26:33,792 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml' 2026-02-14T10:26:33,793 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml' 2026-02-14T10:26:33,795 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml' 2026-02-14T10:26:33,796 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml' 2026-02-14T10:26:33,797 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml' 2026-02-14T10:26:33,798 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml' 2026-02-14T10:26:33,799 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml' 2026-02-14T10:26:33,800 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml' 2026-02-14T10:26:33,802 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml' 2026-02-14T10:26:33,803 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml' 2026-02-14T10:26:33,804 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml' 2026-02-14T10:26:33,805 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml' 2026-02-14T10:26:33,807 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml' 2026-02-14T10:26:33,808 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml' 2026-02-14T10:26:33,810 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml' 2026-02-14T10:26:33,811 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml' 2026-02-14T10:26:33,812 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml' 2026-02-14T10:26:33,813 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml' 2026-02-14T10:26:33,814 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml' 2026-02-14T10:26:33,816 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml' 2026-02-14T10:26:33,817 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml' 2026-02-14T10:26:33,818 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml' 2026-02-14T10:26:33,819 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml' 2026-02-14T10:26:33,820 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml' 2026-02-14T10:26:33,822 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml' 2026-02-14T10:26:33,823 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml' 2026-02-14T10:26:33,824 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml' 2026-02-14T10:26:33,825 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml' 2026-02-14T10:26:33,826 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml' 2026-02-14T10:26:33,828 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml' 2026-02-14T10:26:33,829 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml' 2026-02-14T10:26:33,830 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml' 2026-02-14T10:26:33,832 adding 'lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml' 2026-02-14T10:26:33,834 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml' 2026-02-14T10:26:33,835 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml' 2026-02-14T10:26:33,836 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml' 2026-02-14T10:26:33,837 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml' 2026-02-14T10:26:33,838 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml' 2026-02-14T10:26:33,840 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml' 2026-02-14T10:26:33,841 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml' 2026-02-14T10:26:33,842 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml' 2026-02-14T10:26:33,843 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml' 2026-02-14T10:26:33,844 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml' 2026-02-14T10:26:33,845 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml' 2026-02-14T10:26:33,846 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml' 2026-02-14T10:26:33,847 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml' 2026-02-14T10:26:33,848 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml' 2026-02-14T10:26:33,850 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml' 2026-02-14T10:26:33,851 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml' 2026-02-14T10:26:33,852 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml' 2026-02-14T10:26:33,853 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml' 2026-02-14T10:26:33,854 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml' 2026-02-14T10:26:33,856 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml' 2026-02-14T10:26:33,857 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml' 2026-02-14T10:26:33,859 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml' 2026-02-14T10:26:33,860 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml' 2026-02-14T10:26:33,861 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml' 2026-02-14T10:26:33,862 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml' 2026-02-14T10:26:33,863 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml' 2026-02-14T10:26:33,864 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml' 2026-02-14T10:26:33,866 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml' 2026-02-14T10:26:33,867 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml' 2026-02-14T10:26:33,868 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml' 2026-02-14T10:26:33,869 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml' 2026-02-14T10:26:33,870 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml' 2026-02-14T10:26:33,871 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml' 2026-02-14T10:26:33,873 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml' 2026-02-14T10:26:33,874 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml' 2026-02-14T10:26:33,875 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml' 2026-02-14T10:26:33,876 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml' 2026-02-14T10:26:33,878 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml' 2026-02-14T10:26:33,879 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml' 2026-02-14T10:26:33,881 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml' 2026-02-14T10:26:33,882 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml' 2026-02-14T10:26:33,883 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml' 2026-02-14T10:26:33,884 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml' 2026-02-14T10:26:33,885 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml' 2026-02-14T10:26:33,887 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml' 2026-02-14T10:26:33,888 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml' 2026-02-14T10:26:33,889 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml' 2026-02-14T10:26:33,890 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml' 2026-02-14T10:26:33,891 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml' 2026-02-14T10:26:33,892 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml' 2026-02-14T10:26:33,893 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml' 2026-02-14T10:26:33,895 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml' 2026-02-14T10:26:33,896 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml' 2026-02-14T10:26:33,897 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml' 2026-02-14T10:26:33,898 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml' 2026-02-14T10:26:33,899 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml' 2026-02-14T10:26:33,900 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml' 2026-02-14T10:26:33,902 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml' 2026-02-14T10:26:33,904 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml' 2026-02-14T10:26:33,905 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml' 2026-02-14T10:26:33,907 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml' 2026-02-14T10:26:33,908 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml' 2026-02-14T10:26:33,909 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml' 2026-02-14T10:26:33,910 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml' 2026-02-14T10:26:33,911 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml' 2026-02-14T10:26:33,912 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml' 2026-02-14T10:26:33,914 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml' 2026-02-14T10:26:33,915 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml' 2026-02-14T10:26:33,916 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml' 2026-02-14T10:26:33,917 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml' 2026-02-14T10:26:33,919 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml' 2026-02-14T10:26:33,920 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml' 2026-02-14T10:26:33,921 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml' 2026-02-14T10:26:33,922 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml' 2026-02-14T10:26:33,924 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml' 2026-02-14T10:26:33,925 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml' 2026-02-14T10:26:33,927 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml' 2026-02-14T10:26:33,929 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml' 2026-02-14T10:26:33,930 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml' 2026-02-14T10:26:33,931 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml' 2026-02-14T10:26:33,932 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml' 2026-02-14T10:26:33,933 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml' 2026-02-14T10:26:33,934 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml' 2026-02-14T10:26:33,935 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml' 2026-02-14T10:26:33,937 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml' 2026-02-14T10:26:33,938 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml' 2026-02-14T10:26:33,939 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml' 2026-02-14T10:26:33,940 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml' 2026-02-14T10:26:33,942 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml' 2026-02-14T10:26:33,943 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml' 2026-02-14T10:26:33,944 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml' 2026-02-14T10:26:33,945 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml' 2026-02-14T10:26:33,947 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml' 2026-02-14T10:26:33,948 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml' 2026-02-14T10:26:33,949 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml' 2026-02-14T10:26:33,951 adding 'lm_eval/tasks/afrimmlu/README.md' 2026-02-14T10:26:33,952 adding 'lm_eval/tasks/afrimmlu/fewshot.sh' 2026-02-14T10:26:33,954 adding 'lm_eval/tasks/afrimmlu/gen_utils.py' 2026-02-14T10:26:33,955 adding 'lm_eval/tasks/afrimmlu/utils.py' 2026-02-14T10:26:33,957 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml' 2026-02-14T10:26:33,959 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct' 2026-02-14T10:26:33,960 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml' 2026-02-14T10:26:33,961 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml' 2026-02-14T10:26:33,962 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml' 2026-02-14T10:26:33,963 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml' 2026-02-14T10:26:33,964 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml' 2026-02-14T10:26:33,965 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml' 2026-02-14T10:26:33,967 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml' 2026-02-14T10:26:33,968 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml' 2026-02-14T10:26:33,969 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml' 2026-02-14T10:26:33,970 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml' 2026-02-14T10:26:33,971 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml' 2026-02-14T10:26:33,972 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml' 2026-02-14T10:26:33,973 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml' 2026-02-14T10:26:33,975 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml' 2026-02-14T10:26:33,976 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml' 2026-02-14T10:26:33,977 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml' 2026-02-14T10:26:33,978 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml' 2026-02-14T10:26:33,980 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml' 2026-02-14T10:26:33,981 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py' 2026-02-14T10:26:33,983 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct' 2026-02-14T10:26:33,984 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml' 2026-02-14T10:26:33,985 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml' 2026-02-14T10:26:33,986 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml' 2026-02-14T10:26:33,987 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml' 2026-02-14T10:26:33,989 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml' 2026-02-14T10:26:33,990 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml' 2026-02-14T10:26:33,991 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml' 2026-02-14T10:26:33,992 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml' 2026-02-14T10:26:33,993 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml' 2026-02-14T10:26:33,995 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml' 2026-02-14T10:26:33,996 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml' 2026-02-14T10:26:33,997 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml' 2026-02-14T10:26:33,998 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml' 2026-02-14T10:26:33,999 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml' 2026-02-14T10:26:34,000 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml' 2026-02-14T10:26:34,001 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml' 2026-02-14T10:26:34,002 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml' 2026-02-14T10:26:34,003 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml' 2026-02-14T10:26:34,004 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py' 2026-02-14T10:26:34,006 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct' 2026-02-14T10:26:34,007 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml' 2026-02-14T10:26:34,008 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml' 2026-02-14T10:26:34,010 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml' 2026-02-14T10:26:34,011 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml' 2026-02-14T10:26:34,012 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml' 2026-02-14T10:26:34,013 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml' 2026-02-14T10:26:34,014 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml' 2026-02-14T10:26:34,015 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml' 2026-02-14T10:26:34,016 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml' 2026-02-14T10:26:34,018 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml' 2026-02-14T10:26:34,019 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml' 2026-02-14T10:26:34,020 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml' 2026-02-14T10:26:34,021 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml' 2026-02-14T10:26:34,022 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml' 2026-02-14T10:26:34,023 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml' 2026-02-14T10:26:34,025 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml' 2026-02-14T10:26:34,026 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml' 2026-02-14T10:26:34,027 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml' 2026-02-14T10:26:34,028 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py' 2026-02-14T10:26:34,030 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct' 2026-02-14T10:26:34,031 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml' 2026-02-14T10:26:34,032 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml' 2026-02-14T10:26:34,033 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml' 2026-02-14T10:26:34,034 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml' 2026-02-14T10:26:34,036 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml' 2026-02-14T10:26:34,037 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml' 2026-02-14T10:26:34,038 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml' 2026-02-14T10:26:34,039 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml' 2026-02-14T10:26:34,040 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml' 2026-02-14T10:26:34,041 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml' 2026-02-14T10:26:34,042 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml' 2026-02-14T10:26:34,043 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml' 2026-02-14T10:26:34,045 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml' 2026-02-14T10:26:34,046 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml' 2026-02-14T10:26:34,047 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml' 2026-02-14T10:26:34,048 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml' 2026-02-14T10:26:34,049 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml' 2026-02-14T10:26:34,050 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml' 2026-02-14T10:26:34,051 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py' 2026-02-14T10:26:34,053 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct' 2026-02-14T10:26:34,054 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml' 2026-02-14T10:26:34,056 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml' 2026-02-14T10:26:34,057 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml' 2026-02-14T10:26:34,058 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml' 2026-02-14T10:26:34,059 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml' 2026-02-14T10:26:34,060 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml' 2026-02-14T10:26:34,061 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml' 2026-02-14T10:26:34,062 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml' 2026-02-14T10:26:34,064 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml' 2026-02-14T10:26:34,065 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml' 2026-02-14T10:26:34,066 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml' 2026-02-14T10:26:34,067 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml' 2026-02-14T10:26:34,068 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml' 2026-02-14T10:26:34,069 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml' 2026-02-14T10:26:34,070 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml' 2026-02-14T10:26:34,072 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml' 2026-02-14T10:26:34,073 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml' 2026-02-14T10:26:34,074 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml' 2026-02-14T10:26:34,075 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py' 2026-02-14T10:26:34,077 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml' 2026-02-14T10:26:34,079 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate' 2026-02-14T10:26:34,080 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml' 2026-02-14T10:26:34,081 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml' 2026-02-14T10:26:34,082 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml' 2026-02-14T10:26:34,083 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml' 2026-02-14T10:26:34,084 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml' 2026-02-14T10:26:34,085 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml' 2026-02-14T10:26:34,087 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml' 2026-02-14T10:26:34,088 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml' 2026-02-14T10:26:34,089 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml' 2026-02-14T10:26:34,090 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml' 2026-02-14T10:26:34,091 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml' 2026-02-14T10:26:34,092 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml' 2026-02-14T10:26:34,093 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml' 2026-02-14T10:26:34,094 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml' 2026-02-14T10:26:34,096 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml' 2026-02-14T10:26:34,097 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml' 2026-02-14T10:26:34,098 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml' 2026-02-14T10:26:34,099 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py' 2026-02-14T10:26:34,101 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate' 2026-02-14T10:26:34,102 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml' 2026-02-14T10:26:34,103 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml' 2026-02-14T10:26:34,104 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml' 2026-02-14T10:26:34,106 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml' 2026-02-14T10:26:34,107 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml' 2026-02-14T10:26:34,108 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml' 2026-02-14T10:26:34,109 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml' 2026-02-14T10:26:34,110 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml' 2026-02-14T10:26:34,111 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml' 2026-02-14T10:26:34,112 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml' 2026-02-14T10:26:34,114 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml' 2026-02-14T10:26:34,115 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml' 2026-02-14T10:26:34,116 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml' 2026-02-14T10:26:34,117 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml' 2026-02-14T10:26:34,118 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml' 2026-02-14T10:26:34,119 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml' 2026-02-14T10:26:34,120 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml' 2026-02-14T10:26:34,122 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py' 2026-02-14T10:26:34,124 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate' 2026-02-14T10:26:34,125 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml' 2026-02-14T10:26:34,126 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml' 2026-02-14T10:26:34,127 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml' 2026-02-14T10:26:34,128 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml' 2026-02-14T10:26:34,129 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml' 2026-02-14T10:26:34,130 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml' 2026-02-14T10:26:34,131 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml' 2026-02-14T10:26:34,132 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml' 2026-02-14T10:26:34,134 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml' 2026-02-14T10:26:34,135 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml' 2026-02-14T10:26:34,136 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml' 2026-02-14T10:26:34,137 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml' 2026-02-14T10:26:34,138 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml' 2026-02-14T10:26:34,139 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml' 2026-02-14T10:26:34,140 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml' 2026-02-14T10:26:34,141 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml' 2026-02-14T10:26:34,142 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml' 2026-02-14T10:26:34,143 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py' 2026-02-14T10:26:34,145 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate' 2026-02-14T10:26:34,147 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml' 2026-02-14T10:26:34,148 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml' 2026-02-14T10:26:34,149 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml' 2026-02-14T10:26:34,150 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml' 2026-02-14T10:26:34,151 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml' 2026-02-14T10:26:34,152 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml' 2026-02-14T10:26:34,153 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml' 2026-02-14T10:26:34,154 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml' 2026-02-14T10:26:34,156 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml' 2026-02-14T10:26:34,157 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml' 2026-02-14T10:26:34,158 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml' 2026-02-14T10:26:34,159 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml' 2026-02-14T10:26:34,160 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml' 2026-02-14T10:26:34,161 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml' 2026-02-14T10:26:34,163 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml' 2026-02-14T10:26:34,164 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml' 2026-02-14T10:26:34,165 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml' 2026-02-14T10:26:34,166 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py' 2026-02-14T10:26:34,168 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate' 2026-02-14T10:26:34,169 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml' 2026-02-14T10:26:34,170 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml' 2026-02-14T10:26:34,171 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml' 2026-02-14T10:26:34,173 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml' 2026-02-14T10:26:34,174 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml' 2026-02-14T10:26:34,175 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml' 2026-02-14T10:26:34,176 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml' 2026-02-14T10:26:34,177 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml' 2026-02-14T10:26:34,178 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml' 2026-02-14T10:26:34,179 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml' 2026-02-14T10:26:34,180 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml' 2026-02-14T10:26:34,181 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml' 2026-02-14T10:26:34,182 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml' 2026-02-14T10:26:34,183 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml' 2026-02-14T10:26:34,185 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml' 2026-02-14T10:26:34,186 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml' 2026-02-14T10:26:34,187 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml' 2026-02-14T10:26:34,188 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py' 2026-02-14T10:26:34,190 adding 'lm_eval/tasks/afrixnli/README.md' 2026-02-14T10:26:34,192 adding 'lm_eval/tasks/afrixnli/gen_utils.py' 2026-02-14T10:26:34,193 adding 'lm_eval/tasks/afrixnli/utils.py' 2026-02-14T10:26:34,195 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml' 2026-02-14T10:26:34,196 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml' 2026-02-14T10:26:34,198 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml' 2026-02-14T10:26:34,199 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml' 2026-02-14T10:26:34,200 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml' 2026-02-14T10:26:34,201 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml' 2026-02-14T10:26:34,202 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml' 2026-02-14T10:26:34,203 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml' 2026-02-14T10:26:34,204 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml' 2026-02-14T10:26:34,206 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml' 2026-02-14T10:26:34,207 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml' 2026-02-14T10:26:34,208 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml' 2026-02-14T10:26:34,209 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml' 2026-02-14T10:26:34,210 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml' 2026-02-14T10:26:34,211 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml' 2026-02-14T10:26:34,212 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml' 2026-02-14T10:26:34,214 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml' 2026-02-14T10:26:34,215 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml' 2026-02-14T10:26:34,216 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml' 2026-02-14T10:26:34,217 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py' 2026-02-14T10:26:34,219 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml' 2026-02-14T10:26:34,220 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml' 2026-02-14T10:26:34,222 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml' 2026-02-14T10:26:34,223 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml' 2026-02-14T10:26:34,224 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml' 2026-02-14T10:26:34,225 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml' 2026-02-14T10:26:34,226 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml' 2026-02-14T10:26:34,227 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml' 2026-02-14T10:26:34,228 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml' 2026-02-14T10:26:34,229 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml' 2026-02-14T10:26:34,230 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml' 2026-02-14T10:26:34,231 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml' 2026-02-14T10:26:34,232 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml' 2026-02-14T10:26:34,234 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml' 2026-02-14T10:26:34,235 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml' 2026-02-14T10:26:34,236 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml' 2026-02-14T10:26:34,237 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml' 2026-02-14T10:26:34,238 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml' 2026-02-14T10:26:34,239 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml' 2026-02-14T10:26:34,240 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py' 2026-02-14T10:26:34,242 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml' 2026-02-14T10:26:34,243 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml' 2026-02-14T10:26:34,244 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml' 2026-02-14T10:26:34,245 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml' 2026-02-14T10:26:34,246 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml' 2026-02-14T10:26:34,248 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml' 2026-02-14T10:26:34,249 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml' 2026-02-14T10:26:34,250 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml' 2026-02-14T10:26:34,251 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml' 2026-02-14T10:26:34,252 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml' 2026-02-14T10:26:34,253 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml' 2026-02-14T10:26:34,254 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml' 2026-02-14T10:26:34,256 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml' 2026-02-14T10:26:34,257 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml' 2026-02-14T10:26:34,258 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml' 2026-02-14T10:26:34,259 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml' 2026-02-14T10:26:34,260 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml' 2026-02-14T10:26:34,261 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml' 2026-02-14T10:26:34,262 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/utils.py' 2026-02-14T10:26:34,264 adding 'lm_eval/tasks/afrixnli/direct/afrixnli.yaml' 2026-02-14T10:26:34,266 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml' 2026-02-14T10:26:34,267 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml' 2026-02-14T10:26:34,268 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml' 2026-02-14T10:26:34,269 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml' 2026-02-14T10:26:34,270 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml' 2026-02-14T10:26:34,271 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml' 2026-02-14T10:26:34,272 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml' 2026-02-14T10:26:34,274 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml' 2026-02-14T10:26:34,275 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml' 2026-02-14T10:26:34,276 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml' 2026-02-14T10:26:34,277 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml' 2026-02-14T10:26:34,278 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml' 2026-02-14T10:26:34,279 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml' 2026-02-14T10:26:34,280 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml' 2026-02-14T10:26:34,282 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml' 2026-02-14T10:26:34,283 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml' 2026-02-14T10:26:34,284 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml' 2026-02-14T10:26:34,285 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml' 2026-02-14T10:26:34,286 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml' 2026-02-14T10:26:34,287 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/utils.py' 2026-02-14T10:26:34,289 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml' 2026-02-14T10:26:34,290 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml' 2026-02-14T10:26:34,292 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml' 2026-02-14T10:26:34,293 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml' 2026-02-14T10:26:34,294 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml' 2026-02-14T10:26:34,295 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml' 2026-02-14T10:26:34,296 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml' 2026-02-14T10:26:34,297 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml' 2026-02-14T10:26:34,298 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml' 2026-02-14T10:26:34,299 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml' 2026-02-14T10:26:34,301 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml' 2026-02-14T10:26:34,302 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml' 2026-02-14T10:26:34,303 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml' 2026-02-14T10:26:34,304 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml' 2026-02-14T10:26:34,305 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml' 2026-02-14T10:26:34,306 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml' 2026-02-14T10:26:34,308 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml' 2026-02-14T10:26:34,309 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml' 2026-02-14T10:26:34,310 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml' 2026-02-14T10:26:34,311 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/utils.py' 2026-02-14T10:26:34,313 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml' 2026-02-14T10:26:34,314 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml' 2026-02-14T10:26:34,315 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml' 2026-02-14T10:26:34,317 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml' 2026-02-14T10:26:34,318 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml' 2026-02-14T10:26:34,319 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml' 2026-02-14T10:26:34,320 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml' 2026-02-14T10:26:34,321 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml' 2026-02-14T10:26:34,322 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml' 2026-02-14T10:26:34,323 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml' 2026-02-14T10:26:34,324 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml' 2026-02-14T10:26:34,326 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml' 2026-02-14T10:26:34,327 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml' 2026-02-14T10:26:34,328 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml' 2026-02-14T10:26:34,329 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml' 2026-02-14T10:26:34,330 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml' 2026-02-14T10:26:34,331 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml' 2026-02-14T10:26:34,333 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml' 2026-02-14T10:26:34,334 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml' 2026-02-14T10:26:34,335 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/utils.py' 2026-02-14T10:26:34,337 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml' 2026-02-14T10:26:34,338 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml' 2026-02-14T10:26:34,346 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml' 2026-02-14T10:26:34,347 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml' 2026-02-14T10:26:34,348 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml' 2026-02-14T10:26:34,349 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml' 2026-02-14T10:26:34,350 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml' 2026-02-14T10:26:34,352 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml' 2026-02-14T10:26:34,353 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml' 2026-02-14T10:26:34,354 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml' 2026-02-14T10:26:34,355 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml' 2026-02-14T10:26:34,356 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml' 2026-02-14T10:26:34,357 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml' 2026-02-14T10:26:34,359 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml' 2026-02-14T10:26:34,360 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml' 2026-02-14T10:26:34,361 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml' 2026-02-14T10:26:34,362 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml' 2026-02-14T10:26:34,363 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml' 2026-02-14T10:26:34,365 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml' 2026-02-14T10:26:34,366 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/utils.py' 2026-02-14T10:26:34,368 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml' 2026-02-14T10:26:34,369 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml' 2026-02-14T10:26:34,370 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml' 2026-02-14T10:26:34,371 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml' 2026-02-14T10:26:34,372 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml' 2026-02-14T10:26:34,373 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml' 2026-02-14T10:26:34,375 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml' 2026-02-14T10:26:34,376 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml' 2026-02-14T10:26:34,377 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml' 2026-02-14T10:26:34,378 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml' 2026-02-14T10:26:34,379 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml' 2026-02-14T10:26:34,380 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml' 2026-02-14T10:26:34,381 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml' 2026-02-14T10:26:34,383 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml' 2026-02-14T10:26:34,384 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml' 2026-02-14T10:26:34,385 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml' 2026-02-14T10:26:34,386 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml' 2026-02-14T10:26:34,387 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml' 2026-02-14T10:26:34,388 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml' 2026-02-14T10:26:34,389 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/utils.py' 2026-02-14T10:26:34,391 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml' 2026-02-14T10:26:34,392 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml' 2026-02-14T10:26:34,394 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml' 2026-02-14T10:26:34,395 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml' 2026-02-14T10:26:34,396 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml' 2026-02-14T10:26:34,397 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml' 2026-02-14T10:26:34,398 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml' 2026-02-14T10:26:34,399 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml' 2026-02-14T10:26:34,400 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml' 2026-02-14T10:26:34,401 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml' 2026-02-14T10:26:34,402 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml' 2026-02-14T10:26:34,403 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml' 2026-02-14T10:26:34,404 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml' 2026-02-14T10:26:34,406 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml' 2026-02-14T10:26:34,407 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml' 2026-02-14T10:26:34,408 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml' 2026-02-14T10:26:34,409 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml' 2026-02-14T10:26:34,410 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml' 2026-02-14T10:26:34,411 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml' 2026-02-14T10:26:34,413 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/utils.py' 2026-02-14T10:26:34,414 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml' 2026-02-14T10:26:34,416 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml' 2026-02-14T10:26:34,417 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml' 2026-02-14T10:26:34,418 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml' 2026-02-14T10:26:34,419 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml' 2026-02-14T10:26:34,420 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml' 2026-02-14T10:26:34,421 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml' 2026-02-14T10:26:34,422 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml' 2026-02-14T10:26:34,424 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml' 2026-02-14T10:26:34,425 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml' 2026-02-14T10:26:34,426 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml' 2026-02-14T10:26:34,427 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml' 2026-02-14T10:26:34,428 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml' 2026-02-14T10:26:34,429 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml' 2026-02-14T10:26:34,430 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml' 2026-02-14T10:26:34,431 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml' 2026-02-14T10:26:34,432 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml' 2026-02-14T10:26:34,434 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml' 2026-02-14T10:26:34,435 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/utils.py' 2026-02-14T10:26:34,437 adding 'lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml' 2026-02-14T10:26:34,438 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml' 2026-02-14T10:26:34,439 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml' 2026-02-14T10:26:34,441 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml' 2026-02-14T10:26:34,442 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml' 2026-02-14T10:26:34,443 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml' 2026-02-14T10:26:34,444 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml' 2026-02-14T10:26:34,445 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml' 2026-02-14T10:26:34,446 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml' 2026-02-14T10:26:34,448 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml' 2026-02-14T10:26:34,449 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml' 2026-02-14T10:26:34,450 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml' 2026-02-14T10:26:34,451 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml' 2026-02-14T10:26:34,452 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml' 2026-02-14T10:26:34,454 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml' 2026-02-14T10:26:34,455 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml' 2026-02-14T10:26:34,456 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml' 2026-02-14T10:26:34,457 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml' 2026-02-14T10:26:34,459 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml' 2026-02-14T10:26:34,460 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/utils.py' 2026-02-14T10:26:34,462 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml' 2026-02-14T10:26:34,463 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml' 2026-02-14T10:26:34,464 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml' 2026-02-14T10:26:34,465 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml' 2026-02-14T10:26:34,466 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml' 2026-02-14T10:26:34,467 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml' 2026-02-14T10:26:34,469 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml' 2026-02-14T10:26:34,470 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml' 2026-02-14T10:26:34,471 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml' 2026-02-14T10:26:34,472 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml' 2026-02-14T10:26:34,473 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml' 2026-02-14T10:26:34,474 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml' 2026-02-14T10:26:34,475 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml' 2026-02-14T10:26:34,477 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml' 2026-02-14T10:26:34,478 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml' 2026-02-14T10:26:34,479 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml' 2026-02-14T10:26:34,480 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml' 2026-02-14T10:26:34,481 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml' 2026-02-14T10:26:34,482 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/utils.py' 2026-02-14T10:26:34,485 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml' 2026-02-14T10:26:34,486 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml' 2026-02-14T10:26:34,487 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml' 2026-02-14T10:26:34,489 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml' 2026-02-14T10:26:34,490 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml' 2026-02-14T10:26:34,491 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml' 2026-02-14T10:26:34,492 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml' 2026-02-14T10:26:34,493 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml' 2026-02-14T10:26:34,494 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml' 2026-02-14T10:26:34,496 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml' 2026-02-14T10:26:34,497 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml' 2026-02-14T10:26:34,498 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml' 2026-02-14T10:26:34,499 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml' 2026-02-14T10:26:34,500 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml' 2026-02-14T10:26:34,502 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml' 2026-02-14T10:26:34,503 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml' 2026-02-14T10:26:34,504 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml' 2026-02-14T10:26:34,505 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml' 2026-02-14T10:26:34,506 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/utils.py' 2026-02-14T10:26:34,508 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml' 2026-02-14T10:26:34,509 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml' 2026-02-14T10:26:34,511 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml' 2026-02-14T10:26:34,512 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml' 2026-02-14T10:26:34,513 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml' 2026-02-14T10:26:34,515 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml' 2026-02-14T10:26:34,516 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml' 2026-02-14T10:26:34,517 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml' 2026-02-14T10:26:34,518 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml' 2026-02-14T10:26:34,520 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml' 2026-02-14T10:26:34,521 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml' 2026-02-14T10:26:34,522 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml' 2026-02-14T10:26:34,523 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml' 2026-02-14T10:26:34,524 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml' 2026-02-14T10:26:34,525 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml' 2026-02-14T10:26:34,526 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml' 2026-02-14T10:26:34,527 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml' 2026-02-14T10:26:34,529 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml' 2026-02-14T10:26:34,530 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/utils.py' 2026-02-14T10:26:34,532 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml' 2026-02-14T10:26:34,533 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml' 2026-02-14T10:26:34,534 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml' 2026-02-14T10:26:34,535 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml' 2026-02-14T10:26:34,536 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml' 2026-02-14T10:26:34,537 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml' 2026-02-14T10:26:34,538 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml' 2026-02-14T10:26:34,540 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml' 2026-02-14T10:26:34,541 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml' 2026-02-14T10:26:34,542 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml' 2026-02-14T10:26:34,543 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml' 2026-02-14T10:26:34,544 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml' 2026-02-14T10:26:34,546 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml' 2026-02-14T10:26:34,547 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml' 2026-02-14T10:26:34,548 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml' 2026-02-14T10:26:34,549 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml' 2026-02-14T10:26:34,550 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml' 2026-02-14T10:26:34,551 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml' 2026-02-14T10:26:34,553 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/utils.py' 2026-02-14T10:26:34,555 adding 'lm_eval/tasks/afrobench/README.md' 2026-02-14T10:26:34,556 adding 'lm_eval/tasks/afrobench/afrobench-lite.yaml' 2026-02-14T10:26:34,557 adding 'lm_eval/tasks/afrobench/afrobench.yaml' 2026-02-14T10:26:34,559 adding 'lm_eval/tasks/afrobench/adr/README.md' 2026-02-14T10:26:34,560 adding 'lm_eval/tasks/afrobench/adr/afridiacritics.yaml' 2026-02-14T10:26:34,561 adding 'lm_eval/tasks/afrobench/adr/gen_utils.py' 2026-02-14T10:26:34,563 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml' 2026-02-14T10:26:34,565 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml' 2026-02-14T10:26:34,566 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml' 2026-02-14T10:26:34,567 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml' 2026-02-14T10:26:34,568 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml' 2026-02-14T10:26:34,569 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml' 2026-02-14T10:26:34,571 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml' 2026-02-14T10:26:34,572 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml' 2026-02-14T10:26:34,573 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml' 2026-02-14T10:26:34,574 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml' 2026-02-14T10:26:34,575 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml' 2026-02-14T10:26:34,577 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml' 2026-02-14T10:26:34,578 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml' 2026-02-14T10:26:34,579 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml' 2026-02-14T10:26:34,580 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml' 2026-02-14T10:26:34,581 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml' 2026-02-14T10:26:34,582 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml' 2026-02-14T10:26:34,584 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml' 2026-02-14T10:26:34,585 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml' 2026-02-14T10:26:34,587 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml' 2026-02-14T10:26:34,588 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml' 2026-02-14T10:26:34,589 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml' 2026-02-14T10:26:34,590 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml' 2026-02-14T10:26:34,591 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml' 2026-02-14T10:26:34,593 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml' 2026-02-14T10:26:34,594 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml' 2026-02-14T10:26:34,595 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml' 2026-02-14T10:26:34,596 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml' 2026-02-14T10:26:34,598 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml' 2026-02-14T10:26:34,599 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml' 2026-02-14T10:26:34,601 adding 'lm_eval/tasks/afrobench/afriqa/README.md' 2026-02-14T10:26:34,602 adding 'lm_eval/tasks/afrobench/afriqa/afriqa.yaml' 2026-02-14T10:26:34,603 adding 'lm_eval/tasks/afrobench/afriqa/utils.py' 2026-02-14T10:26:34,605 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa' 2026-02-14T10:26:34,607 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml' 2026-02-14T10:26:34,608 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml' 2026-02-14T10:26:34,609 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml' 2026-02-14T10:26:34,610 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml' 2026-02-14T10:26:34,611 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml' 2026-02-14T10:26:34,612 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml' 2026-02-14T10:26:34,614 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml' 2026-02-14T10:26:34,615 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml' 2026-02-14T10:26:34,616 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml' 2026-02-14T10:26:34,617 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py' 2026-02-14T10:26:34,619 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa' 2026-02-14T10:26:34,620 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml' 2026-02-14T10:26:34,622 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml' 2026-02-14T10:26:34,623 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml' 2026-02-14T10:26:34,624 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml' 2026-02-14T10:26:34,625 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml' 2026-02-14T10:26:34,627 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml' 2026-02-14T10:26:34,628 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml' 2026-02-14T10:26:34,629 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml' 2026-02-14T10:26:34,630 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml' 2026-02-14T10:26:34,631 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py' 2026-02-14T10:26:34,633 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa' 2026-02-14T10:26:34,634 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml' 2026-02-14T10:26:34,635 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml' 2026-02-14T10:26:34,636 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml' 2026-02-14T10:26:34,638 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml' 2026-02-14T10:26:34,639 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml' 2026-02-14T10:26:34,640 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml' 2026-02-14T10:26:34,641 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml' 2026-02-14T10:26:34,642 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml' 2026-02-14T10:26:34,643 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml' 2026-02-14T10:26:34,645 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py' 2026-02-14T10:26:34,646 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa' 2026-02-14T10:26:34,648 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml' 2026-02-14T10:26:34,649 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml' 2026-02-14T10:26:34,650 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml' 2026-02-14T10:26:34,651 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml' 2026-02-14T10:26:34,652 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml' 2026-02-14T10:26:34,653 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml' 2026-02-14T10:26:34,655 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml' 2026-02-14T10:26:34,656 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml' 2026-02-14T10:26:34,657 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml' 2026-02-14T10:26:34,658 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py' 2026-02-14T10:26:34,660 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa' 2026-02-14T10:26:34,661 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml' 2026-02-14T10:26:34,663 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml' 2026-02-14T10:26:34,664 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml' 2026-02-14T10:26:34,665 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml' 2026-02-14T10:26:34,666 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml' 2026-02-14T10:26:34,667 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml' 2026-02-14T10:26:34,668 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml' 2026-02-14T10:26:34,670 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml' 2026-02-14T10:26:34,671 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml' 2026-02-14T10:26:34,672 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py' 2026-02-14T10:26:34,674 adding 'lm_eval/tasks/afrobench/afrisenti/README.md' 2026-02-14T10:26:34,675 adding 'lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml' 2026-02-14T10:26:34,677 adding 'lm_eval/tasks/afrobench/afrisenti/fewshot.sh' 2026-02-14T10:26:34,678 adding 'lm_eval/tasks/afrobench/afrisenti/utils.py' 2026-02-14T10:26:34,680 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti' 2026-02-14T10:26:34,682 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml' 2026-02-14T10:26:34,683 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml' 2026-02-14T10:26:34,684 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml' 2026-02-14T10:26:34,685 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml' 2026-02-14T10:26:34,686 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml' 2026-02-14T10:26:34,687 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml' 2026-02-14T10:26:34,688 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml' 2026-02-14T10:26:34,689 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml' 2026-02-14T10:26:34,690 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml' 2026-02-14T10:26:34,692 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml' 2026-02-14T10:26:34,693 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml' 2026-02-14T10:26:34,694 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml' 2026-02-14T10:26:34,695 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml' 2026-02-14T10:26:34,696 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml' 2026-02-14T10:26:34,697 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh' 2026-02-14T10:26:34,698 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py' 2026-02-14T10:26:34,699 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py' 2026-02-14T10:26:34,701 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti' 2026-02-14T10:26:34,703 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml' 2026-02-14T10:26:34,704 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml' 2026-02-14T10:26:34,705 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml' 2026-02-14T10:26:34,706 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml' 2026-02-14T10:26:34,707 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml' 2026-02-14T10:26:34,708 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml' 2026-02-14T10:26:34,709 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml' 2026-02-14T10:26:34,710 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml' 2026-02-14T10:26:34,711 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml' 2026-02-14T10:26:34,713 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml' 2026-02-14T10:26:34,714 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml' 2026-02-14T10:26:34,715 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml' 2026-02-14T10:26:34,716 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml' 2026-02-14T10:26:34,717 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml' 2026-02-14T10:26:34,718 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh' 2026-02-14T10:26:34,719 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py' 2026-02-14T10:26:34,721 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py' 2026-02-14T10:26:34,722 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti' 2026-02-14T10:26:34,724 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml' 2026-02-14T10:26:34,725 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml' 2026-02-14T10:26:34,726 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml' 2026-02-14T10:26:34,727 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml' 2026-02-14T10:26:34,728 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml' 2026-02-14T10:26:34,729 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml' 2026-02-14T10:26:34,731 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml' 2026-02-14T10:26:34,732 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml' 2026-02-14T10:26:34,733 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml' 2026-02-14T10:26:34,734 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml' 2026-02-14T10:26:34,735 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml' 2026-02-14T10:26:34,737 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml' 2026-02-14T10:26:34,738 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml' 2026-02-14T10:26:34,739 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml' 2026-02-14T10:26:34,740 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py' 2026-02-14T10:26:34,741 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py' 2026-02-14T10:26:34,743 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti' 2026-02-14T10:26:34,744 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml' 2026-02-14T10:26:34,745 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml' 2026-02-14T10:26:34,746 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml' 2026-02-14T10:26:34,747 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml' 2026-02-14T10:26:34,748 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml' 2026-02-14T10:26:34,750 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml' 2026-02-14T10:26:34,751 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml' 2026-02-14T10:26:34,752 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml' 2026-02-14T10:26:34,753 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml' 2026-02-14T10:26:34,754 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml' 2026-02-14T10:26:34,756 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml' 2026-02-14T10:26:34,757 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml' 2026-02-14T10:26:34,758 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml' 2026-02-14T10:26:34,759 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml' 2026-02-14T10:26:34,760 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py' 2026-02-14T10:26:34,761 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py' 2026-02-14T10:26:34,763 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti' 2026-02-14T10:26:34,764 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml' 2026-02-14T10:26:34,766 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml' 2026-02-14T10:26:34,767 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml' 2026-02-14T10:26:34,794 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml' 2026-02-14T10:26:34,795 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml' 2026-02-14T10:26:34,797 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml' 2026-02-14T10:26:34,798 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml' 2026-02-14T10:26:34,799 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml' 2026-02-14T10:26:34,800 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml' 2026-02-14T10:26:34,802 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml' 2026-02-14T10:26:34,803 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml' 2026-02-14T10:26:34,804 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml' 2026-02-14T10:26:34,805 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml' 2026-02-14T10:26:34,807 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml' 2026-02-14T10:26:34,808 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py' 2026-02-14T10:26:34,809 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py' 2026-02-14T10:26:34,811 adding 'lm_eval/tasks/afrobench/belebele/README.md' 2026-02-14T10:26:34,812 adding 'lm_eval/tasks/afrobench/belebele/belebele.yaml' 2026-02-14T10:26:34,814 adding 'lm_eval/tasks/afrobench/belebele/utils.py' 2026-02-14T10:26:34,816 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele' 2026-02-14T10:26:34,817 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml' 2026-02-14T10:26:34,819 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml' 2026-02-14T10:26:34,820 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml' 2026-02-14T10:26:34,821 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml' 2026-02-14T10:26:34,822 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml' 2026-02-14T10:26:34,823 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml' 2026-02-14T10:26:34,824 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml' 2026-02-14T10:26:34,825 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml' 2026-02-14T10:26:34,826 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml' 2026-02-14T10:26:34,827 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml' 2026-02-14T10:26:34,829 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml' 2026-02-14T10:26:34,830 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml' 2026-02-14T10:26:34,831 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml' 2026-02-14T10:26:34,832 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml' 2026-02-14T10:26:34,833 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml' 2026-02-14T10:26:34,835 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml' 2026-02-14T10:26:34,836 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml' 2026-02-14T10:26:34,837 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml' 2026-02-14T10:26:34,838 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml' 2026-02-14T10:26:34,839 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml' 2026-02-14T10:26:34,840 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml' 2026-02-14T10:26:34,841 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml' 2026-02-14T10:26:34,842 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml' 2026-02-14T10:26:34,843 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml' 2026-02-14T10:26:34,845 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml' 2026-02-14T10:26:34,846 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml' 2026-02-14T10:26:34,847 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml' 2026-02-14T10:26:34,848 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml' 2026-02-14T10:26:34,849 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml' 2026-02-14T10:26:34,851 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml' 2026-02-14T10:26:34,852 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml' 2026-02-14T10:26:34,854 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele' 2026-02-14T10:26:34,855 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml' 2026-02-14T10:26:34,856 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml' 2026-02-14T10:26:34,858 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml' 2026-02-14T10:26:34,859 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml' 2026-02-14T10:26:34,860 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml' 2026-02-14T10:26:34,861 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml' 2026-02-14T10:26:34,862 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml' 2026-02-14T10:26:34,864 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml' 2026-02-14T10:26:34,865 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml' 2026-02-14T10:26:34,866 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml' 2026-02-14T10:26:34,867 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml' 2026-02-14T10:26:34,868 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml' 2026-02-14T10:26:34,869 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml' 2026-02-14T10:26:34,871 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml' 2026-02-14T10:26:34,872 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml' 2026-02-14T10:26:34,873 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml' 2026-02-14T10:26:34,874 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml' 2026-02-14T10:26:34,875 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml' 2026-02-14T10:26:34,876 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml' 2026-02-14T10:26:34,877 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml' 2026-02-14T10:26:34,878 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml' 2026-02-14T10:26:34,879 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml' 2026-02-14T10:26:34,880 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml' 2026-02-14T10:26:34,882 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml' 2026-02-14T10:26:34,883 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml' 2026-02-14T10:26:34,884 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml' 2026-02-14T10:26:34,885 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml' 2026-02-14T10:26:34,887 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml' 2026-02-14T10:26:34,888 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml' 2026-02-14T10:26:34,889 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml' 2026-02-14T10:26:34,890 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml' 2026-02-14T10:26:34,892 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele' 2026-02-14T10:26:34,893 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml' 2026-02-14T10:26:34,894 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml' 2026-02-14T10:26:34,896 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml' 2026-02-14T10:26:34,897 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml' 2026-02-14T10:26:34,898 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml' 2026-02-14T10:26:34,899 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml' 2026-02-14T10:26:34,900 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml' 2026-02-14T10:26:34,901 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml' 2026-02-14T10:26:34,903 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml' 2026-02-14T10:26:34,904 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml' 2026-02-14T10:26:34,905 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml' 2026-02-14T10:26:34,906 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml' 2026-02-14T10:26:34,908 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml' 2026-02-14T10:26:34,909 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml' 2026-02-14T10:26:34,910 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml' 2026-02-14T10:26:34,911 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml' 2026-02-14T10:26:34,912 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml' 2026-02-14T10:26:34,913 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml' 2026-02-14T10:26:34,915 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml' 2026-02-14T10:26:34,916 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml' 2026-02-14T10:26:34,917 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml' 2026-02-14T10:26:34,918 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml' 2026-02-14T10:26:34,920 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml' 2026-02-14T10:26:34,921 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml' 2026-02-14T10:26:34,922 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml' 2026-02-14T10:26:34,923 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml' 2026-02-14T10:26:34,924 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml' 2026-02-14T10:26:34,925 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml' 2026-02-14T10:26:34,926 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml' 2026-02-14T10:26:34,928 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml' 2026-02-14T10:26:34,929 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml' 2026-02-14T10:26:34,931 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele' 2026-02-14T10:26:34,932 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml' 2026-02-14T10:26:34,933 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml' 2026-02-14T10:26:34,934 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml' 2026-02-14T10:26:34,935 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml' 2026-02-14T10:26:34,937 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml' 2026-02-14T10:26:34,938 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml' 2026-02-14T10:26:34,939 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml' 2026-02-14T10:26:34,940 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml' 2026-02-14T10:26:34,941 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml' 2026-02-14T10:26:34,943 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml' 2026-02-14T10:26:34,944 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml' 2026-02-14T10:26:34,945 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml' 2026-02-14T10:26:34,946 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml' 2026-02-14T10:26:34,947 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml' 2026-02-14T10:26:34,948 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml' 2026-02-14T10:26:34,949 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml' 2026-02-14T10:26:34,951 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml' 2026-02-14T10:26:34,952 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml' 2026-02-14T10:26:34,953 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml' 2026-02-14T10:26:34,954 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml' 2026-02-14T10:26:34,955 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml' 2026-02-14T10:26:34,956 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml' 2026-02-14T10:26:34,958 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml' 2026-02-14T10:26:34,959 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml' 2026-02-14T10:26:34,960 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml' 2026-02-14T10:26:34,961 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml' 2026-02-14T10:26:34,962 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml' 2026-02-14T10:26:34,964 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml' 2026-02-14T10:26:34,965 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml' 2026-02-14T10:26:34,966 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml' 2026-02-14T10:26:34,967 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml' 2026-02-14T10:26:34,970 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele' 2026-02-14T10:26:34,971 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml' 2026-02-14T10:26:34,972 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml' 2026-02-14T10:26:34,973 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml' 2026-02-14T10:26:34,974 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml' 2026-02-14T10:26:34,976 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml' 2026-02-14T10:26:34,977 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml' 2026-02-14T10:26:34,978 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml' 2026-02-14T10:26:34,979 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml' 2026-02-14T10:26:34,980 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml' 2026-02-14T10:26:34,981 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml' 2026-02-14T10:26:34,982 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml' 2026-02-14T10:26:34,983 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml' 2026-02-14T10:26:34,984 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml' 2026-02-14T10:26:34,985 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml' 2026-02-14T10:26:34,986 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml' 2026-02-14T10:26:34,988 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml' 2026-02-14T10:26:34,989 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml' 2026-02-14T10:26:34,990 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml' 2026-02-14T10:26:34,991 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml' 2026-02-14T10:26:34,992 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml' 2026-02-14T10:26:34,993 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml' 2026-02-14T10:26:34,994 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml' 2026-02-14T10:26:34,996 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml' 2026-02-14T10:26:34,997 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml' 2026-02-14T10:26:34,998 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml' 2026-02-14T10:26:34,999 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml' 2026-02-14T10:26:35,000 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml' 2026-02-14T10:26:35,002 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml' 2026-02-14T10:26:35,003 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml' 2026-02-14T10:26:35,004 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml' 2026-02-14T10:26:35,005 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml' 2026-02-14T10:26:35,007 adding 'lm_eval/tasks/afrobench/flores/README.md' 2026-02-14T10:26:35,008 adding 'lm_eval/tasks/afrobench/flores/flores.yaml' 2026-02-14T10:26:35,010 adding 'lm_eval/tasks/afrobench/flores/gen_utils.py' 2026-02-14T10:26:35,012 adding 'lm_eval/tasks/afrobench/flores/prompt_1/flores' 2026-02-14T10:26:35,015 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores' 2026-02-14T10:26:35,016 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,017 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,018 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,019 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,020 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,022 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,023 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml' 2026-02-14T10:26:35,024 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,025 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,026 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,027 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,028 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,030 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,031 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,032 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,033 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,034 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,035 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,036 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,037 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,039 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,040 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,041 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,042 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,043 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,044 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,045 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,046 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,048 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,049 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,050 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,051 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,052 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,053 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,054 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,056 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,057 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,058 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,059 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,060 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,061 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,063 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,064 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,065 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,067 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,068 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,069 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,070 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,071 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,072 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,073 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml' 2026-02-14T10:26:35,074 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml' 2026-02-14T10:26:35,075 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,077 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,078 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,079 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,080 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2026-02-14T10:26:35,081 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,082 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,083 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,084 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,086 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,089 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores' 2026-02-14T10:26:35,090 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml' 2026-02-14T10:26:35,091 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml' 2026-02-14T10:26:35,092 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml' 2026-02-14T10:26:35,093 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml' 2026-02-14T10:26:35,094 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml' 2026-02-14T10:26:35,096 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml' 2026-02-14T10:26:35,097 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml' 2026-02-14T10:26:35,098 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml' 2026-02-14T10:26:35,099 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml' 2026-02-14T10:26:35,101 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml' 2026-02-14T10:26:35,102 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml' 2026-02-14T10:26:35,103 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml' 2026-02-14T10:26:35,105 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml' 2026-02-14T10:26:35,106 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml' 2026-02-14T10:26:35,108 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml' 2026-02-14T10:26:35,109 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml' 2026-02-14T10:26:35,110 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml' 2026-02-14T10:26:35,111 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml' 2026-02-14T10:26:35,112 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml' 2026-02-14T10:26:35,113 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml' 2026-02-14T10:26:35,114 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml' 2026-02-14T10:26:35,116 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml' 2026-02-14T10:26:35,117 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml' 2026-02-14T10:26:35,118 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml' 2026-02-14T10:26:35,119 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml' 2026-02-14T10:26:35,120 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml' 2026-02-14T10:26:35,122 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml' 2026-02-14T10:26:35,123 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml' 2026-02-14T10:26:35,124 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml' 2026-02-14T10:26:35,125 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml' 2026-02-14T10:26:35,126 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml' 2026-02-14T10:26:35,127 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml' 2026-02-14T10:26:35,128 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml' 2026-02-14T10:26:35,129 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml' 2026-02-14T10:26:35,131 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml' 2026-02-14T10:26:35,132 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml' 2026-02-14T10:26:35,133 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml' 2026-02-14T10:26:35,134 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml' 2026-02-14T10:26:35,135 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml' 2026-02-14T10:26:35,137 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml' 2026-02-14T10:26:35,138 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml' 2026-02-14T10:26:35,139 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml' 2026-02-14T10:26:35,140 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml' 2026-02-14T10:26:35,142 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml' 2026-02-14T10:26:35,143 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml' 2026-02-14T10:26:35,144 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml' 2026-02-14T10:26:35,146 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml' 2026-02-14T10:26:35,147 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml' 2026-02-14T10:26:35,148 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml' 2026-02-14T10:26:35,149 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml' 2026-02-14T10:26:35,150 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml' 2026-02-14T10:26:35,152 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml' 2026-02-14T10:26:35,153 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml' 2026-02-14T10:26:35,154 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml' 2026-02-14T10:26:35,155 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml' 2026-02-14T10:26:35,156 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml' 2026-02-14T10:26:35,157 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2026-02-14T10:26:35,158 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml' 2026-02-14T10:26:35,159 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml' 2026-02-14T10:26:35,161 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml' 2026-02-14T10:26:35,162 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml' 2026-02-14T10:26:35,163 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml' 2026-02-14T10:26:35,164 adding 'lm_eval/tasks/afrobench/flores/prompt_2/flores' 2026-02-14T10:26:35,167 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores' 2026-02-14T10:26:35,168 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,169 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,170 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,172 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,173 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,174 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,175 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml' 2026-02-14T10:26:35,176 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,178 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,179 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,180 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,182 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,183 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,184 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,186 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,187 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,188 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,189 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,191 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,192 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,193 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,194 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,195 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,197 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,198 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,199 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,200 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,201 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,202 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,204 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,205 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,206 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,207 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,208 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,210 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,211 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,212 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,213 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,214 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,216 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,217 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,218 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,219 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,220 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,222 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,223 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,224 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,225 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,227 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,228 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,229 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml' 2026-02-14T10:26:35,230 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml' 2026-02-14T10:26:35,231 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,233 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,234 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,235 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,236 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2026-02-14T10:26:35,237 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,238 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,239 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,241 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,242 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,244 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores' 2026-02-14T10:26:35,245 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml' 2026-02-14T10:26:35,247 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml' 2026-02-14T10:26:35,248 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml' 2026-02-14T10:26:35,249 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml' 2026-02-14T10:26:35,250 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml' 2026-02-14T10:26:35,251 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml' 2026-02-14T10:26:35,252 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml' 2026-02-14T10:26:35,253 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml' 2026-02-14T10:26:35,255 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml' 2026-02-14T10:26:35,256 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml' 2026-02-14T10:26:35,257 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml' 2026-02-14T10:26:35,258 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml' 2026-02-14T10:26:35,259 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml' 2026-02-14T10:26:35,260 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml' 2026-02-14T10:26:35,262 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml' 2026-02-14T10:26:35,263 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml' 2026-02-14T10:26:35,264 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml' 2026-02-14T10:26:35,265 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml' 2026-02-14T10:26:35,266 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml' 2026-02-14T10:26:35,268 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml' 2026-02-14T10:26:35,269 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml' 2026-02-14T10:26:35,270 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml' 2026-02-14T10:26:35,271 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml' 2026-02-14T10:26:35,272 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml' 2026-02-14T10:26:35,274 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml' 2026-02-14T10:26:35,275 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml' 2026-02-14T10:26:35,276 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml' 2026-02-14T10:26:35,277 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml' 2026-02-14T10:26:35,278 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml' 2026-02-14T10:26:35,279 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml' 2026-02-14T10:26:35,280 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml' 2026-02-14T10:26:35,281 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml' 2026-02-14T10:26:35,282 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml' 2026-02-14T10:26:35,284 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml' 2026-02-14T10:26:35,285 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml' 2026-02-14T10:26:35,286 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml' 2026-02-14T10:26:35,287 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml' 2026-02-14T10:26:35,288 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml' 2026-02-14T10:26:35,289 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml' 2026-02-14T10:26:35,291 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml' 2026-02-14T10:26:35,292 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml' 2026-02-14T10:26:35,293 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml' 2026-02-14T10:26:35,294 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml' 2026-02-14T10:26:35,295 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml' 2026-02-14T10:26:35,296 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml' 2026-02-14T10:26:35,298 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml' 2026-02-14T10:26:35,299 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml' 2026-02-14T10:26:35,300 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml' 2026-02-14T10:26:35,301 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml' 2026-02-14T10:26:35,302 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml' 2026-02-14T10:26:35,303 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml' 2026-02-14T10:26:35,305 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml' 2026-02-14T10:26:35,306 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml' 2026-02-14T10:26:35,307 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml' 2026-02-14T10:26:35,308 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml' 2026-02-14T10:26:35,309 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml' 2026-02-14T10:26:35,310 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2026-02-14T10:26:35,312 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml' 2026-02-14T10:26:35,313 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml' 2026-02-14T10:26:35,314 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml' 2026-02-14T10:26:35,315 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml' 2026-02-14T10:26:35,316 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml' 2026-02-14T10:26:35,318 adding 'lm_eval/tasks/afrobench/flores/prompt_3/flores' 2026-02-14T10:26:35,320 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores' 2026-02-14T10:26:35,321 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,322 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,324 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,325 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,326 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,327 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,328 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml' 2026-02-14T10:26:35,329 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,331 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,332 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,333 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,334 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,335 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,336 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,338 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,339 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,340 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,341 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,342 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,343 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,345 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,346 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,348 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,349 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,350 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,351 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,352 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,354 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,355 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,356 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml' 2026-02-14T10:26:35,357 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,358 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,359 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,360 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,361 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,362 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,364 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,365 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,366 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,367 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,368 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,369 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,370 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,372 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,373 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,374 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,375 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,376 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,378 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,379 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,380 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml' 2026-02-14T10:26:35,381 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml' 2026-02-14T10:26:35,382 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,383 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,385 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,386 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,387 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2026-02-14T10:26:35,388 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,389 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,391 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,392 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,393 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml' 2026-02-14T10:26:35,396 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores' 2026-02-14T10:26:35,397 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml' 2026-02-14T10:26:35,398 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml' 2026-02-14T10:26:35,399 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml' 2026-02-14T10:26:35,400 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml' 2026-02-14T10:26:35,401 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml' 2026-02-14T10:26:35,403 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml' 2026-02-14T10:26:35,404 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml' 2026-02-14T10:26:35,405 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml' 2026-02-14T10:26:35,406 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml' 2026-02-14T10:26:35,407 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml' 2026-02-14T10:26:35,408 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml' 2026-02-14T10:26:35,409 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml' 2026-02-14T10:26:35,411 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml' 2026-02-14T10:26:35,412 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml' 2026-02-14T10:26:35,413 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml' 2026-02-14T10:26:35,414 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml' 2026-02-14T10:26:35,415 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml' 2026-02-14T10:26:35,416 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml' 2026-02-14T10:26:35,418 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml' 2026-02-14T10:26:35,419 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml' 2026-02-14T10:26:35,420 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml' 2026-02-14T10:26:35,421 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml' 2026-02-14T10:26:35,422 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml' 2026-02-14T10:26:35,423 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml' 2026-02-14T10:26:35,424 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml' 2026-02-14T10:26:35,426 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml' 2026-02-14T10:26:35,427 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml' 2026-02-14T10:26:35,428 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml' 2026-02-14T10:26:35,429 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml' 2026-02-14T10:26:35,430 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml' 2026-02-14T10:26:35,432 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml' 2026-02-14T10:26:35,433 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml' 2026-02-14T10:26:35,434 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml' 2026-02-14T10:26:35,435 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml' 2026-02-14T10:26:35,436 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml' 2026-02-14T10:26:35,437 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml' 2026-02-14T10:26:35,438 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml' 2026-02-14T10:26:35,439 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml' 2026-02-14T10:26:35,441 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml' 2026-02-14T10:26:35,442 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml' 2026-02-14T10:26:35,443 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml' 2026-02-14T10:26:35,444 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml' 2026-02-14T10:26:35,445 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml' 2026-02-14T10:26:35,446 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml' 2026-02-14T10:26:35,447 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml' 2026-02-14T10:26:35,449 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml' 2026-02-14T10:26:35,450 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml' 2026-02-14T10:26:35,451 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml' 2026-02-14T10:26:35,452 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml' 2026-02-14T10:26:35,453 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml' 2026-02-14T10:26:35,454 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml' 2026-02-14T10:26:35,455 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml' 2026-02-14T10:26:35,457 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml' 2026-02-14T10:26:35,458 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml' 2026-02-14T10:26:35,459 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml' 2026-02-14T10:26:35,460 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml' 2026-02-14T10:26:35,461 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2026-02-14T10:26:35,462 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml' 2026-02-14T10:26:35,463 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml' 2026-02-14T10:26:35,465 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml' 2026-02-14T10:26:35,466 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml' 2026-02-14T10:26:35,467 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml' 2026-02-14T10:26:35,469 adding 'lm_eval/tasks/afrobench/injongointent/README.md' 2026-02-14T10:26:35,471 adding 'lm_eval/tasks/afrobench/injongointent/gen_utils.py' 2026-02-14T10:26:35,472 adding 'lm_eval/tasks/afrobench/injongointent/injongointent.yaml' 2026-02-14T10:26:35,474 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent' 2026-02-14T10:26:35,475 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml' 2026-02-14T10:26:35,476 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml' 2026-02-14T10:26:35,478 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml' 2026-02-14T10:26:35,479 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml' 2026-02-14T10:26:35,480 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml' 2026-02-14T10:26:35,481 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml' 2026-02-14T10:26:35,482 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml' 2026-02-14T10:26:35,483 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml' 2026-02-14T10:26:35,484 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml' 2026-02-14T10:26:35,486 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml' 2026-02-14T10:26:35,487 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml' 2026-02-14T10:26:35,488 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml' 2026-02-14T10:26:35,489 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml' 2026-02-14T10:26:35,491 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml' 2026-02-14T10:26:35,492 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml' 2026-02-14T10:26:35,493 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml' 2026-02-14T10:26:35,494 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml' 2026-02-14T10:26:35,495 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py' 2026-02-14T10:26:35,497 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent' 2026-02-14T10:26:35,499 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml' 2026-02-14T10:26:35,500 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml' 2026-02-14T10:26:35,501 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml' 2026-02-14T10:26:35,502 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml' 2026-02-14T10:26:35,503 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml' 2026-02-14T10:26:35,505 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml' 2026-02-14T10:26:35,506 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml' 2026-02-14T10:26:35,507 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml' 2026-02-14T10:26:35,508 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml' 2026-02-14T10:26:35,509 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml' 2026-02-14T10:26:35,511 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml' 2026-02-14T10:26:35,512 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml' 2026-02-14T10:26:35,513 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml' 2026-02-14T10:26:35,514 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml' 2026-02-14T10:26:35,516 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml' 2026-02-14T10:26:35,517 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml' 2026-02-14T10:26:35,518 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml' 2026-02-14T10:26:35,519 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py' 2026-02-14T10:26:35,521 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent' 2026-02-14T10:26:35,522 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml' 2026-02-14T10:26:35,524 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml' 2026-02-14T10:26:35,525 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml' 2026-02-14T10:26:35,526 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml' 2026-02-14T10:26:35,527 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml' 2026-02-14T10:26:35,528 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml' 2026-02-14T10:26:35,530 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml' 2026-02-14T10:26:35,531 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml' 2026-02-14T10:26:35,532 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml' 2026-02-14T10:26:35,533 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml' 2026-02-14T10:26:35,535 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml' 2026-02-14T10:26:35,536 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml' 2026-02-14T10:26:35,537 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml' 2026-02-14T10:26:35,538 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml' 2026-02-14T10:26:35,539 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml' 2026-02-14T10:26:35,541 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml' 2026-02-14T10:26:35,542 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml' 2026-02-14T10:26:35,543 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py' 2026-02-14T10:26:35,545 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent' 2026-02-14T10:26:35,546 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml' 2026-02-14T10:26:35,547 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml' 2026-02-14T10:26:35,548 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml' 2026-02-14T10:26:35,550 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml' 2026-02-14T10:26:35,551 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml' 2026-02-14T10:26:35,552 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml' 2026-02-14T10:26:35,553 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml' 2026-02-14T10:26:35,554 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml' 2026-02-14T10:26:35,556 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml' 2026-02-14T10:26:35,557 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml' 2026-02-14T10:26:35,558 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml' 2026-02-14T10:26:35,559 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml' 2026-02-14T10:26:35,560 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml' 2026-02-14T10:26:35,562 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml' 2026-02-14T10:26:35,563 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml' 2026-02-14T10:26:35,564 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml' 2026-02-14T10:26:35,565 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml' 2026-02-14T10:26:35,567 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py' 2026-02-14T10:26:35,568 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent' 2026-02-14T10:26:35,570 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml' 2026-02-14T10:26:35,571 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml' 2026-02-14T10:26:35,572 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml' 2026-02-14T10:26:35,573 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml' 2026-02-14T10:26:35,575 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml' 2026-02-14T10:26:35,576 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml' 2026-02-14T10:26:35,577 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml' 2026-02-14T10:26:35,578 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml' 2026-02-14T10:26:35,579 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml' 2026-02-14T10:26:35,580 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml' 2026-02-14T10:26:35,581 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml' 2026-02-14T10:26:35,582 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml' 2026-02-14T10:26:35,584 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml' 2026-02-14T10:26:35,585 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml' 2026-02-14T10:26:35,586 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml' 2026-02-14T10:26:35,587 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml' 2026-02-14T10:26:35,588 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml' 2026-02-14T10:26:35,589 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py' 2026-02-14T10:26:35,591 adding 'lm_eval/tasks/afrobench/mafand/README.md' 2026-02-14T10:26:35,593 adding 'lm_eval/tasks/afrobench/mafand/gen_utils.py' 2026-02-14T10:26:35,594 adding 'lm_eval/tasks/afrobench/mafand/mafand.yaml' 2026-02-14T10:26:35,596 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand' 2026-02-14T10:26:35,597 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml' 2026-02-14T10:26:35,599 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml' 2026-02-14T10:26:35,600 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml' 2026-02-14T10:26:35,601 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml' 2026-02-14T10:26:35,602 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml' 2026-02-14T10:26:35,603 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml' 2026-02-14T10:26:35,604 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml' 2026-02-14T10:26:35,605 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml' 2026-02-14T10:26:35,606 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml' 2026-02-14T10:26:35,608 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml' 2026-02-14T10:26:35,609 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml' 2026-02-14T10:26:35,610 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml' 2026-02-14T10:26:35,611 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml' 2026-02-14T10:26:35,612 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml' 2026-02-14T10:26:35,613 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml' 2026-02-14T10:26:35,614 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml' 2026-02-14T10:26:35,616 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml' 2026-02-14T10:26:35,617 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml' 2026-02-14T10:26:35,618 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml' 2026-02-14T10:26:35,619 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml' 2026-02-14T10:26:35,620 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml' 2026-02-14T10:26:35,621 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py' 2026-02-14T10:26:35,623 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand' 2026-02-14T10:26:35,625 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml' 2026-02-14T10:26:35,626 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml' 2026-02-14T10:26:35,627 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml' 2026-02-14T10:26:35,628 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml' 2026-02-14T10:26:35,629 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml' 2026-02-14T10:26:35,630 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml' 2026-02-14T10:26:35,631 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml' 2026-02-14T10:26:35,632 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml' 2026-02-14T10:26:35,633 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml' 2026-02-14T10:26:35,634 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml' 2026-02-14T10:26:35,635 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml' 2026-02-14T10:26:35,636 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml' 2026-02-14T10:26:35,637 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml' 2026-02-14T10:26:35,639 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml' 2026-02-14T10:26:35,640 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml' 2026-02-14T10:26:35,641 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml' 2026-02-14T10:26:35,642 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml' 2026-02-14T10:26:35,643 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml' 2026-02-14T10:26:35,644 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml' 2026-02-14T10:26:35,645 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml' 2026-02-14T10:26:35,646 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml' 2026-02-14T10:26:35,648 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py' 2026-02-14T10:26:35,650 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand' 2026-02-14T10:26:35,651 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml' 2026-02-14T10:26:35,652 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml' 2026-02-14T10:26:35,654 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml' 2026-02-14T10:26:35,655 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml' 2026-02-14T10:26:35,656 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml' 2026-02-14T10:26:35,657 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml' 2026-02-14T10:26:35,658 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml' 2026-02-14T10:26:35,659 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml' 2026-02-14T10:26:35,660 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml' 2026-02-14T10:26:35,661 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml' 2026-02-14T10:26:35,663 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml' 2026-02-14T10:26:35,664 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml' 2026-02-14T10:26:35,665 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml' 2026-02-14T10:26:35,666 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml' 2026-02-14T10:26:35,667 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml' 2026-02-14T10:26:35,668 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml' 2026-02-14T10:26:35,669 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml' 2026-02-14T10:26:35,670 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml' 2026-02-14T10:26:35,671 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml' 2026-02-14T10:26:35,672 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml' 2026-02-14T10:26:35,673 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml' 2026-02-14T10:26:35,675 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py' 2026-02-14T10:26:35,677 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand' 2026-02-14T10:26:35,678 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml' 2026-02-14T10:26:35,679 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml' 2026-02-14T10:26:35,680 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml' 2026-02-14T10:26:35,681 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml' 2026-02-14T10:26:35,682 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml' 2026-02-14T10:26:35,683 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml' 2026-02-14T10:26:35,684 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml' 2026-02-14T10:26:35,685 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml' 2026-02-14T10:26:35,686 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml' 2026-02-14T10:26:35,688 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml' 2026-02-14T10:26:35,689 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml' 2026-02-14T10:26:35,690 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml' 2026-02-14T10:26:35,691 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml' 2026-02-14T10:26:35,692 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml' 2026-02-14T10:26:35,693 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml' 2026-02-14T10:26:35,694 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml' 2026-02-14T10:26:35,695 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml' 2026-02-14T10:26:35,696 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml' 2026-02-14T10:26:35,697 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml' 2026-02-14T10:26:35,699 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml' 2026-02-14T10:26:35,700 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml' 2026-02-14T10:26:35,701 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py' 2026-02-14T10:26:35,704 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand' 2026-02-14T10:26:35,705 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml' 2026-02-14T10:26:35,706 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml' 2026-02-14T10:26:35,707 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml' 2026-02-14T10:26:35,708 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml' 2026-02-14T10:26:35,709 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml' 2026-02-14T10:26:35,710 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml' 2026-02-14T10:26:35,711 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml' 2026-02-14T10:26:35,712 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml' 2026-02-14T10:26:35,713 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml' 2026-02-14T10:26:35,714 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml' 2026-02-14T10:26:35,716 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml' 2026-02-14T10:26:35,717 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml' 2026-02-14T10:26:35,718 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml' 2026-02-14T10:26:35,719 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml' 2026-02-14T10:26:35,720 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml' 2026-02-14T10:26:35,721 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml' 2026-02-14T10:26:35,722 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml' 2026-02-14T10:26:35,723 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml' 2026-02-14T10:26:35,724 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml' 2026-02-14T10:26:35,725 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml' 2026-02-14T10:26:35,726 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml' 2026-02-14T10:26:35,727 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py' 2026-02-14T10:26:35,729 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand' 2026-02-14T10:26:35,730 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml' 2026-02-14T10:26:35,732 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml' 2026-02-14T10:26:35,733 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml' 2026-02-14T10:26:35,734 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml' 2026-02-14T10:26:35,735 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml' 2026-02-14T10:26:35,736 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml' 2026-02-14T10:26:35,737 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml' 2026-02-14T10:26:35,738 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml' 2026-02-14T10:26:35,739 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml' 2026-02-14T10:26:35,741 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml' 2026-02-14T10:26:35,742 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml' 2026-02-14T10:26:35,743 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml' 2026-02-14T10:26:35,744 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml' 2026-02-14T10:26:35,745 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml' 2026-02-14T10:26:35,746 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml' 2026-02-14T10:26:35,747 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml' 2026-02-14T10:26:35,749 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml' 2026-02-14T10:26:35,750 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml' 2026-02-14T10:26:35,751 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml' 2026-02-14T10:26:35,752 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml' 2026-02-14T10:26:35,753 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml' 2026-02-14T10:26:35,754 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py' 2026-02-14T10:26:35,756 adding 'lm_eval/tasks/afrobench/masakhaner/README.md' 2026-02-14T10:26:35,758 adding 'lm_eval/tasks/afrobench/masakhaner/gen_utils.py' 2026-02-14T10:26:35,759 adding 'lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml' 2026-02-14T10:26:35,761 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner' 2026-02-14T10:26:35,762 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml' 2026-02-14T10:26:35,763 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml' 2026-02-14T10:26:35,764 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml' 2026-02-14T10:26:35,765 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml' 2026-02-14T10:26:35,767 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml' 2026-02-14T10:26:35,768 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml' 2026-02-14T10:26:35,769 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml' 2026-02-14T10:26:35,770 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml' 2026-02-14T10:26:35,771 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml' 2026-02-14T10:26:35,772 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml' 2026-02-14T10:26:35,774 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml' 2026-02-14T10:26:35,775 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml' 2026-02-14T10:26:35,776 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml' 2026-02-14T10:26:35,777 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml' 2026-02-14T10:26:35,778 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml' 2026-02-14T10:26:35,780 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml' 2026-02-14T10:26:35,781 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml' 2026-02-14T10:26:35,782 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml' 2026-02-14T10:26:35,783 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml' 2026-02-14T10:26:35,785 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml' 2026-02-14T10:26:35,786 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py' 2026-02-14T10:26:35,788 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner' 2026-02-14T10:26:35,789 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml' 2026-02-14T10:26:35,790 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml' 2026-02-14T10:26:35,792 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml' 2026-02-14T10:26:35,793 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml' 2026-02-14T10:26:35,794 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml' 2026-02-14T10:26:35,795 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml' 2026-02-14T10:26:35,797 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml' 2026-02-14T10:26:35,798 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml' 2026-02-14T10:26:35,799 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml' 2026-02-14T10:26:35,800 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml' 2026-02-14T10:26:35,802 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml' 2026-02-14T10:26:35,803 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml' 2026-02-14T10:26:35,804 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml' 2026-02-14T10:26:35,806 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml' 2026-02-14T10:26:35,807 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml' 2026-02-14T10:26:35,808 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml' 2026-02-14T10:26:35,809 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml' 2026-02-14T10:26:35,810 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml' 2026-02-14T10:26:35,811 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml' 2026-02-14T10:26:35,812 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml' 2026-02-14T10:26:35,814 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py' 2026-02-14T10:26:35,816 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner' 2026-02-14T10:26:35,817 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml' 2026-02-14T10:26:35,818 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml' 2026-02-14T10:26:35,819 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml' 2026-02-14T10:26:35,821 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml' 2026-02-14T10:26:35,822 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml' 2026-02-14T10:26:35,823 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml' 2026-02-14T10:26:35,824 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml' 2026-02-14T10:26:35,825 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml' 2026-02-14T10:26:35,826 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml' 2026-02-14T10:26:35,828 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml' 2026-02-14T10:26:35,829 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml' 2026-02-14T10:26:35,830 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml' 2026-02-14T10:26:35,831 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml' 2026-02-14T10:26:35,832 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml' 2026-02-14T10:26:35,834 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml' 2026-02-14T10:26:35,835 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml' 2026-02-14T10:26:35,836 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml' 2026-02-14T10:26:35,837 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml' 2026-02-14T10:26:35,838 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml' 2026-02-14T10:26:35,840 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml' 2026-02-14T10:26:35,841 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py' 2026-02-14T10:26:35,843 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner' 2026-02-14T10:26:35,844 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml' 2026-02-14T10:26:35,845 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml' 2026-02-14T10:26:35,847 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml' 2026-02-14T10:26:35,848 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml' 2026-02-14T10:26:35,849 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml' 2026-02-14T10:26:35,850 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml' 2026-02-14T10:26:35,852 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml' 2026-02-14T10:26:35,853 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml' 2026-02-14T10:26:35,854 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml' 2026-02-14T10:26:35,855 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml' 2026-02-14T10:26:35,856 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml' 2026-02-14T10:26:35,858 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml' 2026-02-14T10:26:35,859 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml' 2026-02-14T10:26:35,860 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml' 2026-02-14T10:26:35,861 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml' 2026-02-14T10:26:35,862 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml' 2026-02-14T10:26:35,863 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml' 2026-02-14T10:26:35,864 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml' 2026-02-14T10:26:35,865 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml' 2026-02-14T10:26:35,867 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml' 2026-02-14T10:26:35,868 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py' 2026-02-14T10:26:35,870 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner' 2026-02-14T10:26:35,871 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml' 2026-02-14T10:26:35,872 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml' 2026-02-14T10:26:35,873 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml' 2026-02-14T10:26:35,875 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml' 2026-02-14T10:26:35,876 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml' 2026-02-14T10:26:35,877 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml' 2026-02-14T10:26:35,878 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml' 2026-02-14T10:26:35,879 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml' 2026-02-14T10:26:35,881 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml' 2026-02-14T10:26:35,882 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml' 2026-02-14T10:26:35,883 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml' 2026-02-14T10:26:35,884 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml' 2026-02-14T10:26:35,885 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml' 2026-02-14T10:26:35,887 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml' 2026-02-14T10:26:35,888 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml' 2026-02-14T10:26:35,889 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml' 2026-02-14T10:26:35,890 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml' 2026-02-14T10:26:35,892 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml' 2026-02-14T10:26:35,893 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml' 2026-02-14T10:26:35,894 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml' 2026-02-14T10:26:35,896 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py' 2026-02-14T10:26:35,898 adding 'lm_eval/tasks/afrobench/masakhanews/README.md' 2026-02-14T10:26:35,899 adding 'lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml' 2026-02-14T10:26:35,901 adding 'lm_eval/tasks/afrobench/masakhanews/utils.py' 2026-02-14T10:26:35,902 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews' 2026-02-14T10:26:35,904 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml' 2026-02-14T10:26:35,905 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml' 2026-02-14T10:26:35,906 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml' 2026-02-14T10:26:35,908 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml' 2026-02-14T10:26:35,909 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml' 2026-02-14T10:26:35,910 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml' 2026-02-14T10:26:35,911 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml' 2026-02-14T10:26:35,912 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml' 2026-02-14T10:26:35,913 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml' 2026-02-14T10:26:35,915 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml' 2026-02-14T10:26:35,916 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml' 2026-02-14T10:26:35,917 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml' 2026-02-14T10:26:35,918 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml' 2026-02-14T10:26:35,919 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml' 2026-02-14T10:26:35,920 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml' 2026-02-14T10:26:35,921 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml' 2026-02-14T10:26:35,922 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py' 2026-02-14T10:26:35,924 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews' 2026-02-14T10:26:35,925 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml' 2026-02-14T10:26:35,926 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml' 2026-02-14T10:26:35,927 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml' 2026-02-14T10:26:35,929 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml' 2026-02-14T10:26:35,930 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml' 2026-02-14T10:26:35,931 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml' 2026-02-14T10:26:35,932 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml' 2026-02-14T10:26:35,933 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml' 2026-02-14T10:26:35,934 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml' 2026-02-14T10:26:35,935 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml' 2026-02-14T10:26:35,937 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml' 2026-02-14T10:26:35,938 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml' 2026-02-14T10:26:35,939 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml' 2026-02-14T10:26:35,940 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml' 2026-02-14T10:26:35,941 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml' 2026-02-14T10:26:35,942 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml' 2026-02-14T10:26:35,943 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py' 2026-02-14T10:26:35,945 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews' 2026-02-14T10:26:35,947 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml' 2026-02-14T10:26:35,948 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml' 2026-02-14T10:26:35,949 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml' 2026-02-14T10:26:35,950 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml' 2026-02-14T10:26:35,952 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml' 2026-02-14T10:26:35,953 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml' 2026-02-14T10:26:35,954 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml' 2026-02-14T10:26:35,955 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml' 2026-02-14T10:26:35,956 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml' 2026-02-14T10:26:35,958 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml' 2026-02-14T10:26:35,959 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml' 2026-02-14T10:26:35,960 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml' 2026-02-14T10:26:35,961 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml' 2026-02-14T10:26:35,962 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml' 2026-02-14T10:26:35,963 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml' 2026-02-14T10:26:35,965 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml' 2026-02-14T10:26:35,966 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py' 2026-02-14T10:26:35,968 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews' 2026-02-14T10:26:35,969 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml' 2026-02-14T10:26:35,970 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml' 2026-02-14T10:26:35,971 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml' 2026-02-14T10:26:35,972 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml' 2026-02-14T10:26:35,973 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml' 2026-02-14T10:26:35,974 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml' 2026-02-14T10:26:35,976 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml' 2026-02-14T10:26:35,977 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml' 2026-02-14T10:26:35,978 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml' 2026-02-14T10:26:35,979 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml' 2026-02-14T10:26:35,980 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml' 2026-02-14T10:26:35,981 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml' 2026-02-14T10:26:35,982 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml' 2026-02-14T10:26:35,983 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml' 2026-02-14T10:26:35,985 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml' 2026-02-14T10:26:35,986 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml' 2026-02-14T10:26:35,987 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py' 2026-02-14T10:26:35,989 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews' 2026-02-14T10:26:35,990 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml' 2026-02-14T10:26:35,991 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml' 2026-02-14T10:26:35,993 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml' 2026-02-14T10:26:35,994 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml' 2026-02-14T10:26:35,995 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml' 2026-02-14T10:26:35,997 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml' 2026-02-14T10:26:35,998 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml' 2026-02-14T10:26:35,999 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml' 2026-02-14T10:26:36,001 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml' 2026-02-14T10:26:36,002 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml' 2026-02-14T10:26:36,003 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml' 2026-02-14T10:26:36,004 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml' 2026-02-14T10:26:36,006 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml' 2026-02-14T10:26:36,007 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml' 2026-02-14T10:26:36,008 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml' 2026-02-14T10:26:36,009 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml' 2026-02-14T10:26:36,011 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py' 2026-02-14T10:26:36,013 adding 'lm_eval/tasks/afrobench/masakhapos/README.md' 2026-02-14T10:26:36,014 adding 'lm_eval/tasks/afrobench/masakhapos/gen_utils.py' 2026-02-14T10:26:36,015 adding 'lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml' 2026-02-14T10:26:36,016 adding 'lm_eval/tasks/afrobench/masakhapos/utils.py' 2026-02-14T10:26:36,018 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml' 2026-02-14T10:26:36,020 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml' 2026-02-14T10:26:36,021 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml' 2026-02-14T10:26:36,022 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml' 2026-02-14T10:26:36,023 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml' 2026-02-14T10:26:36,024 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml' 2026-02-14T10:26:36,026 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml' 2026-02-14T10:26:36,027 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml' 2026-02-14T10:26:36,028 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml' 2026-02-14T10:26:36,029 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml' 2026-02-14T10:26:36,030 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml' 2026-02-14T10:26:36,031 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml' 2026-02-14T10:26:36,033 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml' 2026-02-14T10:26:36,034 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml' 2026-02-14T10:26:36,035 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml' 2026-02-14T10:26:36,036 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml' 2026-02-14T10:26:36,038 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml' 2026-02-14T10:26:36,039 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml' 2026-02-14T10:26:36,040 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml' 2026-02-14T10:26:36,041 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml' 2026-02-14T10:26:36,042 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml' 2026-02-14T10:26:36,044 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py' 2026-02-14T10:26:36,046 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml' 2026-02-14T10:26:36,047 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml' 2026-02-14T10:26:36,048 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml' 2026-02-14T10:26:36,049 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml' 2026-02-14T10:26:36,051 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml' 2026-02-14T10:26:36,052 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml' 2026-02-14T10:26:36,053 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml' 2026-02-14T10:26:36,054 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml' 2026-02-14T10:26:36,055 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml' 2026-02-14T10:26:36,057 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml' 2026-02-14T10:26:36,058 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml' 2026-02-14T10:26:36,059 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml' 2026-02-14T10:26:36,060 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml' 2026-02-14T10:26:36,062 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml' 2026-02-14T10:26:36,063 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml' 2026-02-14T10:26:36,064 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml' 2026-02-14T10:26:36,065 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml' 2026-02-14T10:26:36,067 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml' 2026-02-14T10:26:36,068 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml' 2026-02-14T10:26:36,069 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml' 2026-02-14T10:26:36,070 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml' 2026-02-14T10:26:36,071 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py' 2026-02-14T10:26:36,073 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml' 2026-02-14T10:26:36,074 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml' 2026-02-14T10:26:36,076 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml' 2026-02-14T10:26:36,077 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml' 2026-02-14T10:26:36,078 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml' 2026-02-14T10:26:36,079 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml' 2026-02-14T10:26:36,081 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml' 2026-02-14T10:26:36,082 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml' 2026-02-14T10:26:36,083 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml' 2026-02-14T10:26:36,084 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml' 2026-02-14T10:26:36,085 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml' 2026-02-14T10:26:36,087 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml' 2026-02-14T10:26:36,088 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml' 2026-02-14T10:26:36,089 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml' 2026-02-14T10:26:36,090 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml' 2026-02-14T10:26:36,092 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml' 2026-02-14T10:26:36,093 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml' 2026-02-14T10:26:36,094 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml' 2026-02-14T10:26:36,095 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml' 2026-02-14T10:26:36,096 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml' 2026-02-14T10:26:36,098 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml' 2026-02-14T10:26:36,099 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py' 2026-02-14T10:26:36,101 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml' 2026-02-14T10:26:36,102 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml' 2026-02-14T10:26:36,103 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml' 2026-02-14T10:26:36,105 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml' 2026-02-14T10:26:36,106 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml' 2026-02-14T10:26:36,107 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml' 2026-02-14T10:26:36,108 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml' 2026-02-14T10:26:36,109 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml' 2026-02-14T10:26:36,111 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml' 2026-02-14T10:26:36,112 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml' 2026-02-14T10:26:36,113 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml' 2026-02-14T10:26:36,114 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml' 2026-02-14T10:26:36,116 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml' 2026-02-14T10:26:36,117 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml' 2026-02-14T10:26:36,118 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml' 2026-02-14T10:26:36,119 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml' 2026-02-14T10:26:36,120 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml' 2026-02-14T10:26:36,121 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml' 2026-02-14T10:26:36,122 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml' 2026-02-14T10:26:36,124 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml' 2026-02-14T10:26:36,125 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml' 2026-02-14T10:26:36,126 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py' 2026-02-14T10:26:36,128 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml' 2026-02-14T10:26:36,129 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml' 2026-02-14T10:26:36,130 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml' 2026-02-14T10:26:36,132 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml' 2026-02-14T10:26:36,133 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml' 2026-02-14T10:26:36,134 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml' 2026-02-14T10:26:36,136 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml' 2026-02-14T10:26:36,137 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml' 2026-02-14T10:26:36,138 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml' 2026-02-14T10:26:36,139 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml' 2026-02-14T10:26:36,140 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml' 2026-02-14T10:26:36,142 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml' 2026-02-14T10:26:36,143 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml' 2026-02-14T10:26:36,144 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml' 2026-02-14T10:26:36,145 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml' 2026-02-14T10:26:36,146 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml' 2026-02-14T10:26:36,148 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml' 2026-02-14T10:26:36,149 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml' 2026-02-14T10:26:36,150 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml' 2026-02-14T10:26:36,151 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml' 2026-02-14T10:26:36,153 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml' 2026-02-14T10:26:36,154 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py' 2026-02-14T10:26:36,156 adding 'lm_eval/tasks/afrobench/naijarc/README.md' 2026-02-14T10:26:36,157 adding 'lm_eval/tasks/afrobench/naijarc/naijarc.yaml' 2026-02-14T10:26:36,158 adding 'lm_eval/tasks/afrobench/naijarc/utils.py' 2026-02-14T10:26:36,160 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc' 2026-02-14T10:26:36,162 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml' 2026-02-14T10:26:36,163 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml' 2026-02-14T10:26:36,164 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml' 2026-02-14T10:26:36,166 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc' 2026-02-14T10:26:36,167 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml' 2026-02-14T10:26:36,168 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml' 2026-02-14T10:26:36,170 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml' 2026-02-14T10:26:36,171 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc' 2026-02-14T10:26:36,173 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml' 2026-02-14T10:26:36,174 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml' 2026-02-14T10:26:36,175 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml' 2026-02-14T10:26:36,176 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc' 2026-02-14T10:26:36,177 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml' 2026-02-14T10:26:36,178 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml' 2026-02-14T10:26:36,179 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml' 2026-02-14T10:26:36,181 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc' 2026-02-14T10:26:36,182 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml' 2026-02-14T10:26:36,183 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml' 2026-02-14T10:26:36,185 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml' 2026-02-14T10:26:36,186 adding 'lm_eval/tasks/afrobench/nollysenti/README.md' 2026-02-14T10:26:36,188 adding 'lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml' 2026-02-14T10:26:36,189 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti' 2026-02-14T10:26:36,190 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml' 2026-02-14T10:26:36,192 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml' 2026-02-14T10:26:36,193 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml' 2026-02-14T10:26:36,194 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml' 2026-02-14T10:26:36,195 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml' 2026-02-14T10:26:36,196 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py' 2026-02-14T10:26:36,198 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti' 2026-02-14T10:26:36,199 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml' 2026-02-14T10:26:36,200 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml' 2026-02-14T10:26:36,201 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml' 2026-02-14T10:26:36,203 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml' 2026-02-14T10:26:36,204 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml' 2026-02-14T10:26:36,205 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py' 2026-02-14T10:26:36,207 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti' 2026-02-14T10:26:36,208 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml' 2026-02-14T10:26:36,209 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml' 2026-02-14T10:26:36,210 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml' 2026-02-14T10:26:36,212 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml' 2026-02-14T10:26:36,213 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml' 2026-02-14T10:26:36,214 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py' 2026-02-14T10:26:36,216 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti' 2026-02-14T10:26:36,217 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml' 2026-02-14T10:26:36,218 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml' 2026-02-14T10:26:36,220 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml' 2026-02-14T10:26:36,221 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml' 2026-02-14T10:26:36,222 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml' 2026-02-14T10:26:36,223 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py' 2026-02-14T10:26:36,225 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti' 2026-02-14T10:26:36,227 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml' 2026-02-14T10:26:36,228 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml' 2026-02-14T10:26:36,229 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml' 2026-02-14T10:26:36,231 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml' 2026-02-14T10:26:36,232 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml' 2026-02-14T10:26:36,233 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py' 2026-02-14T10:26:36,235 adding 'lm_eval/tasks/afrobench/ntrex/README.md' 2026-02-14T10:26:36,236 adding 'lm_eval/tasks/afrobench/ntrex/gen_utils.py' 2026-02-14T10:26:36,237 adding 'lm_eval/tasks/afrobench/ntrex/ntrex.yaml' 2026-02-14T10:26:36,240 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex' 2026-02-14T10:26:36,241 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,242 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2026-02-14T10:26:36,243 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,244 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,246 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,247 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,248 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,249 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,250 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,251 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,252 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,254 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,255 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,256 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,257 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,258 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2026-02-14T10:26:36,260 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,261 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,262 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,263 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,265 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,266 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2026-02-14T10:26:36,267 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2026-02-14T10:26:36,268 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2026-02-14T10:26:36,269 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,271 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,272 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,273 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,274 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,275 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,276 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,277 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,279 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex' 2026-02-14T10:26:36,281 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2026-02-14T10:26:36,282 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2026-02-14T10:26:36,283 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2026-02-14T10:26:36,284 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2026-02-14T10:26:36,285 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2026-02-14T10:26:36,286 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2026-02-14T10:26:36,288 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2026-02-14T10:26:36,289 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2026-02-14T10:26:36,290 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2026-02-14T10:26:36,291 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2026-02-14T10:26:36,292 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2026-02-14T10:26:36,293 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2026-02-14T10:26:36,294 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2026-02-14T10:26:36,295 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2026-02-14T10:26:36,297 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2026-02-14T10:26:36,298 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2026-02-14T10:26:36,299 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2026-02-14T10:26:36,300 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2026-02-14T10:26:36,302 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml' 2026-02-14T10:26:36,303 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2026-02-14T10:26:36,304 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2026-02-14T10:26:36,306 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2026-02-14T10:26:36,307 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2026-02-14T10:26:36,308 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2026-02-14T10:26:36,309 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2026-02-14T10:26:36,311 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2026-02-14T10:26:36,312 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2026-02-14T10:26:36,313 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2026-02-14T10:26:36,314 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2026-02-14T10:26:36,315 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2026-02-14T10:26:36,317 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2026-02-14T10:26:36,318 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2026-02-14T10:26:36,320 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex' 2026-02-14T10:26:36,322 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,323 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2026-02-14T10:26:36,324 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,325 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,326 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,327 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,329 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,330 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,331 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,332 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,333 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,334 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,335 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,337 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,338 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,339 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2026-02-14T10:26:36,341 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,342 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,343 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,344 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,346 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,347 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2026-02-14T10:26:36,348 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2026-02-14T10:26:36,350 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2026-02-14T10:26:36,351 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,352 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,353 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,354 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,356 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,357 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,358 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,359 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,361 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex' 2026-02-14T10:26:36,363 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2026-02-14T10:26:36,364 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2026-02-14T10:26:36,365 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2026-02-14T10:26:36,366 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2026-02-14T10:26:36,367 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2026-02-14T10:26:36,368 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2026-02-14T10:26:36,369 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2026-02-14T10:26:36,370 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2026-02-14T10:26:36,372 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2026-02-14T10:26:36,373 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2026-02-14T10:26:36,374 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2026-02-14T10:26:36,375 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2026-02-14T10:26:36,376 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2026-02-14T10:26:36,378 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2026-02-14T10:26:36,379 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2026-02-14T10:26:36,380 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2026-02-14T10:26:36,381 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2026-02-14T10:26:36,383 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2026-02-14T10:26:36,384 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml' 2026-02-14T10:26:36,385 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2026-02-14T10:26:36,386 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2026-02-14T10:26:36,388 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2026-02-14T10:26:36,389 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2026-02-14T10:26:36,390 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2026-02-14T10:26:36,392 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2026-02-14T10:26:36,393 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2026-02-14T10:26:36,394 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2026-02-14T10:26:36,395 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2026-02-14T10:26:36,396 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2026-02-14T10:26:36,398 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2026-02-14T10:26:36,399 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2026-02-14T10:26:36,400 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2026-02-14T10:26:36,403 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex' 2026-02-14T10:26:36,404 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,405 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2026-02-14T10:26:36,406 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,408 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,409 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,410 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,411 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,412 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,413 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,414 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,415 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,417 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,418 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,419 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,420 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,421 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2026-02-14T10:26:36,423 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,424 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,425 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,426 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,427 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,428 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2026-02-14T10:26:36,430 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2026-02-14T10:26:36,431 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2026-02-14T10:26:36,432 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,433 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,435 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2026-02-14T10:26:36,436 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,437 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,438 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,439 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,441 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2026-02-14T10:26:36,443 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex' 2026-02-14T10:26:36,444 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2026-02-14T10:26:36,446 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2026-02-14T10:26:36,447 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2026-02-14T10:26:36,448 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2026-02-14T10:26:36,449 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2026-02-14T10:26:36,450 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2026-02-14T10:26:36,451 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2026-02-14T10:26:36,452 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2026-02-14T10:26:36,454 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2026-02-14T10:26:36,455 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2026-02-14T10:26:36,456 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2026-02-14T10:26:36,457 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2026-02-14T10:26:36,458 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2026-02-14T10:26:36,459 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2026-02-14T10:26:36,460 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2026-02-14T10:26:36,462 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2026-02-14T10:26:36,463 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2026-02-14T10:26:36,464 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2026-02-14T10:26:36,465 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml' 2026-02-14T10:26:36,466 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2026-02-14T10:26:36,467 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2026-02-14T10:26:36,469 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2026-02-14T10:26:36,470 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2026-02-14T10:26:36,471 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2026-02-14T10:26:36,473 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2026-02-14T10:26:36,474 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2026-02-14T10:26:36,475 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2026-02-14T10:26:36,477 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2026-02-14T10:26:36,478 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2026-02-14T10:26:36,480 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2026-02-14T10:26:36,481 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2026-02-14T10:26:36,482 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2026-02-14T10:26:36,484 adding 'lm_eval/tasks/afrobench/openai_mmlu/README.md' 2026-02-14T10:26:36,485 adding 'lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml' 2026-02-14T10:26:36,487 adding 'lm_eval/tasks/afrobench/openai_mmlu/utils.py' 2026-02-14T10:26:36,489 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu' 2026-02-14T10:26:36,490 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml' 2026-02-14T10:26:36,491 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml' 2026-02-14T10:26:36,493 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml' 2026-02-14T10:26:36,494 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu' 2026-02-14T10:26:36,496 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml' 2026-02-14T10:26:36,497 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml' 2026-02-14T10:26:36,498 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml' 2026-02-14T10:26:36,500 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu' 2026-02-14T10:26:36,501 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml' 2026-02-14T10:26:36,502 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml' 2026-02-14T10:26:36,503 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml' 2026-02-14T10:26:36,505 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu' 2026-02-14T10:26:36,506 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml' 2026-02-14T10:26:36,508 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml' 2026-02-14T10:26:36,509 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml' 2026-02-14T10:26:36,511 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu' 2026-02-14T10:26:36,512 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml' 2026-02-14T10:26:36,513 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml' 2026-02-14T10:26:36,514 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml' 2026-02-14T10:26:36,516 adding 'lm_eval/tasks/afrobench/salt/README.md' 2026-02-14T10:26:36,517 adding 'lm_eval/tasks/afrobench/salt/gen_utils.py' 2026-02-14T10:26:36,519 adding 'lm_eval/tasks/afrobench/salt/salt.yaml' 2026-02-14T10:26:36,520 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt' 2026-02-14T10:26:36,522 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml' 2026-02-14T10:26:36,523 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml' 2026-02-14T10:26:36,524 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml' 2026-02-14T10:26:36,525 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml' 2026-02-14T10:26:36,526 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml' 2026-02-14T10:26:36,528 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml' 2026-02-14T10:26:36,529 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml' 2026-02-14T10:26:36,530 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml' 2026-02-14T10:26:36,531 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml' 2026-02-14T10:26:36,532 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml' 2026-02-14T10:26:36,534 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml' 2026-02-14T10:26:36,535 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml' 2026-02-14T10:26:36,536 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml' 2026-02-14T10:26:36,537 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml' 2026-02-14T10:26:36,539 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt' 2026-02-14T10:26:36,540 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml' 2026-02-14T10:26:36,542 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml' 2026-02-14T10:26:36,543 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml' 2026-02-14T10:26:36,544 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml' 2026-02-14T10:26:36,545 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml' 2026-02-14T10:26:36,546 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml' 2026-02-14T10:26:36,548 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml' 2026-02-14T10:26:36,549 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml' 2026-02-14T10:26:36,550 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml' 2026-02-14T10:26:36,551 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml' 2026-02-14T10:26:36,552 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml' 2026-02-14T10:26:36,553 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml' 2026-02-14T10:26:36,554 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml' 2026-02-14T10:26:36,556 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml' 2026-02-14T10:26:36,557 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt' 2026-02-14T10:26:36,558 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml' 2026-02-14T10:26:36,560 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml' 2026-02-14T10:26:36,561 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml' 2026-02-14T10:26:36,562 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml' 2026-02-14T10:26:36,563 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml' 2026-02-14T10:26:36,564 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml' 2026-02-14T10:26:36,566 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml' 2026-02-14T10:26:36,567 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml' 2026-02-14T10:26:36,568 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml' 2026-02-14T10:26:36,569 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml' 2026-02-14T10:26:36,570 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml' 2026-02-14T10:26:36,572 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml' 2026-02-14T10:26:36,573 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml' 2026-02-14T10:26:36,574 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml' 2026-02-14T10:26:36,576 adding 'lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh' 2026-02-14T10:26:36,577 adding 'lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh' 2026-02-14T10:26:36,579 adding 'lm_eval/tasks/afrobench/sib/README.md' 2026-02-14T10:26:36,580 adding 'lm_eval/tasks/afrobench/sib/sib.yaml' 2026-02-14T10:26:36,582 adding 'lm_eval/tasks/afrobench/sib/utils.py' 2026-02-14T10:26:36,585 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib' 2026-02-14T10:26:36,586 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml' 2026-02-14T10:26:36,587 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml' 2026-02-14T10:26:36,588 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml' 2026-02-14T10:26:36,590 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml' 2026-02-14T10:26:36,591 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml' 2026-02-14T10:26:36,592 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml' 2026-02-14T10:26:36,593 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml' 2026-02-14T10:26:36,594 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml' 2026-02-14T10:26:36,596 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml' 2026-02-14T10:26:36,597 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml' 2026-02-14T10:26:36,598 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml' 2026-02-14T10:26:36,599 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml' 2026-02-14T10:26:36,601 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml' 2026-02-14T10:26:36,602 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml' 2026-02-14T10:26:36,603 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml' 2026-02-14T10:26:36,604 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml' 2026-02-14T10:26:36,605 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml' 2026-02-14T10:26:36,607 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml' 2026-02-14T10:26:36,608 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml' 2026-02-14T10:26:36,609 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml' 2026-02-14T10:26:36,610 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml' 2026-02-14T10:26:36,611 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml' 2026-02-14T10:26:36,613 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml' 2026-02-14T10:26:36,614 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml' 2026-02-14T10:26:36,615 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml' 2026-02-14T10:26:36,616 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml' 2026-02-14T10:26:36,617 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml' 2026-02-14T10:26:36,618 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml' 2026-02-14T10:26:36,619 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml' 2026-02-14T10:26:36,621 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml' 2026-02-14T10:26:36,622 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml' 2026-02-14T10:26:36,623 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml' 2026-02-14T10:26:36,624 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml' 2026-02-14T10:26:36,626 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml' 2026-02-14T10:26:36,627 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml' 2026-02-14T10:26:36,628 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml' 2026-02-14T10:26:36,629 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml' 2026-02-14T10:26:36,630 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml' 2026-02-14T10:26:36,631 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml' 2026-02-14T10:26:36,633 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml' 2026-02-14T10:26:36,634 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml' 2026-02-14T10:26:36,635 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml' 2026-02-14T10:26:36,636 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml' 2026-02-14T10:26:36,637 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml' 2026-02-14T10:26:36,638 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml' 2026-02-14T10:26:36,640 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml' 2026-02-14T10:26:36,641 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml' 2026-02-14T10:26:36,642 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml' 2026-02-14T10:26:36,643 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml' 2026-02-14T10:26:36,644 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml' 2026-02-14T10:26:36,646 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml' 2026-02-14T10:26:36,647 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml' 2026-02-14T10:26:36,648 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml' 2026-02-14T10:26:36,649 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml' 2026-02-14T10:26:36,651 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml' 2026-02-14T10:26:36,652 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml' 2026-02-14T10:26:36,653 adding 'lm_eval/tasks/afrobench/sib/prompt_1/utils.py' 2026-02-14T10:26:36,656 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib' 2026-02-14T10:26:36,657 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml' 2026-02-14T10:26:36,658 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml' 2026-02-14T10:26:36,659 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml' 2026-02-14T10:26:36,660 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml' 2026-02-14T10:26:36,662 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml' 2026-02-14T10:26:36,663 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml' 2026-02-14T10:26:36,664 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml' 2026-02-14T10:26:36,665 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml' 2026-02-14T10:26:36,667 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml' 2026-02-14T10:26:36,668 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml' 2026-02-14T10:26:36,669 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml' 2026-02-14T10:26:36,670 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml' 2026-02-14T10:26:36,671 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml' 2026-02-14T10:26:36,673 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml' 2026-02-14T10:26:36,674 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml' 2026-02-14T10:26:36,676 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml' 2026-02-14T10:26:36,677 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml' 2026-02-14T10:26:36,678 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml' 2026-02-14T10:26:36,679 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml' 2026-02-14T10:26:36,680 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml' 2026-02-14T10:26:36,682 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml' 2026-02-14T10:26:36,683 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml' 2026-02-14T10:26:36,684 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml' 2026-02-14T10:26:36,686 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml' 2026-02-14T10:26:36,687 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml' 2026-02-14T10:26:36,688 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml' 2026-02-14T10:26:36,689 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml' 2026-02-14T10:26:36,691 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml' 2026-02-14T10:26:36,692 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml' 2026-02-14T10:26:36,693 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml' 2026-02-14T10:26:36,694 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml' 2026-02-14T10:26:36,695 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml' 2026-02-14T10:26:36,696 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml' 2026-02-14T10:26:36,698 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml' 2026-02-14T10:26:36,699 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml' 2026-02-14T10:26:36,700 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml' 2026-02-14T10:26:36,701 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml' 2026-02-14T10:26:36,702 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml' 2026-02-14T10:26:36,704 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml' 2026-02-14T10:26:36,705 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml' 2026-02-14T10:26:36,706 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml' 2026-02-14T10:26:36,707 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml' 2026-02-14T10:26:36,708 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml' 2026-02-14T10:26:36,710 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml' 2026-02-14T10:26:36,711 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml' 2026-02-14T10:26:36,712 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml' 2026-02-14T10:26:36,713 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml' 2026-02-14T10:26:36,714 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml' 2026-02-14T10:26:36,716 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml' 2026-02-14T10:26:36,717 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml' 2026-02-14T10:26:36,718 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml' 2026-02-14T10:26:36,719 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml' 2026-02-14T10:26:36,720 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml' 2026-02-14T10:26:36,722 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml' 2026-02-14T10:26:36,723 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml' 2026-02-14T10:26:36,724 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml' 2026-02-14T10:26:36,725 adding 'lm_eval/tasks/afrobench/sib/prompt_2/utils.py' 2026-02-14T10:26:36,728 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib' 2026-02-14T10:26:36,729 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml' 2026-02-14T10:26:36,730 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml' 2026-02-14T10:26:36,732 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml' 2026-02-14T10:26:36,733 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml' 2026-02-14T10:26:36,734 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml' 2026-02-14T10:26:36,735 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml' 2026-02-14T10:26:36,737 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml' 2026-02-14T10:26:36,738 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml' 2026-02-14T10:26:36,739 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml' 2026-02-14T10:26:36,740 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml' 2026-02-14T10:26:36,742 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml' 2026-02-14T10:26:36,743 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml' 2026-02-14T10:26:36,744 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml' 2026-02-14T10:26:36,745 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml' 2026-02-14T10:26:36,747 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml' 2026-02-14T10:26:36,748 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml' 2026-02-14T10:26:36,749 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml' 2026-02-14T10:26:36,751 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml' 2026-02-14T10:26:36,752 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml' 2026-02-14T10:26:36,753 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml' 2026-02-14T10:26:36,754 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml' 2026-02-14T10:26:36,755 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml' 2026-02-14T10:26:36,756 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml' 2026-02-14T10:26:36,758 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml' 2026-02-14T10:26:36,759 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml' 2026-02-14T10:26:36,760 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml' 2026-02-14T10:26:36,761 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml' 2026-02-14T10:26:36,763 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml' 2026-02-14T10:26:36,764 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml' 2026-02-14T10:26:36,765 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml' 2026-02-14T10:26:36,766 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml' 2026-02-14T10:26:36,768 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml' 2026-02-14T10:26:36,769 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml' 2026-02-14T10:26:36,770 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml' 2026-02-14T10:26:36,772 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml' 2026-02-14T10:26:36,773 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml' 2026-02-14T10:26:36,774 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml' 2026-02-14T10:26:36,776 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml' 2026-02-14T10:26:36,777 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml' 2026-02-14T10:26:36,778 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml' 2026-02-14T10:26:36,780 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml' 2026-02-14T10:26:36,781 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml' 2026-02-14T10:26:36,782 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml' 2026-02-14T10:26:36,783 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml' 2026-02-14T10:26:36,785 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml' 2026-02-14T10:26:36,786 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml' 2026-02-14T10:26:36,787 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml' 2026-02-14T10:26:36,788 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml' 2026-02-14T10:26:36,789 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml' 2026-02-14T10:26:36,791 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml' 2026-02-14T10:26:36,792 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml' 2026-02-14T10:26:36,793 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml' 2026-02-14T10:26:36,795 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml' 2026-02-14T10:26:36,796 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml' 2026-02-14T10:26:36,797 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml' 2026-02-14T10:26:36,798 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml' 2026-02-14T10:26:36,799 adding 'lm_eval/tasks/afrobench/sib/prompt_3/utils.py' 2026-02-14T10:26:36,802 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib' 2026-02-14T10:26:36,803 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml' 2026-02-14T10:26:36,804 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml' 2026-02-14T10:26:36,805 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml' 2026-02-14T10:26:36,807 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml' 2026-02-14T10:26:36,808 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml' 2026-02-14T10:26:36,809 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml' 2026-02-14T10:26:36,810 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml' 2026-02-14T10:26:36,811 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml' 2026-02-14T10:26:36,813 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml' 2026-02-14T10:26:36,814 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml' 2026-02-14T10:26:36,815 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml' 2026-02-14T10:26:36,816 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml' 2026-02-14T10:26:36,817 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml' 2026-02-14T10:26:36,818 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml' 2026-02-14T10:26:36,820 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml' 2026-02-14T10:26:36,821 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml' 2026-02-14T10:26:36,822 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml' 2026-02-14T10:26:36,824 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml' 2026-02-14T10:26:36,825 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml' 2026-02-14T10:26:36,826 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml' 2026-02-14T10:26:36,827 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml' 2026-02-14T10:26:36,828 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml' 2026-02-14T10:26:36,830 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml' 2026-02-14T10:26:36,831 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml' 2026-02-14T10:26:36,832 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml' 2026-02-14T10:26:36,833 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml' 2026-02-14T10:26:36,834 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml' 2026-02-14T10:26:36,836 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml' 2026-02-14T10:26:36,837 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml' 2026-02-14T10:26:36,838 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml' 2026-02-14T10:26:36,839 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml' 2026-02-14T10:26:36,841 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml' 2026-02-14T10:26:36,842 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml' 2026-02-14T10:26:36,843 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml' 2026-02-14T10:26:36,844 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml' 2026-02-14T10:26:36,845 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml' 2026-02-14T10:26:36,847 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml' 2026-02-14T10:26:36,848 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml' 2026-02-14T10:26:36,849 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml' 2026-02-14T10:26:36,850 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml' 2026-02-14T10:26:36,851 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml' 2026-02-14T10:26:36,852 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml' 2026-02-14T10:26:36,853 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml' 2026-02-14T10:26:36,854 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml' 2026-02-14T10:26:36,856 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml' 2026-02-14T10:26:36,857 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml' 2026-02-14T10:26:36,858 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml' 2026-02-14T10:26:36,859 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml' 2026-02-14T10:26:36,860 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml' 2026-02-14T10:26:36,861 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml' 2026-02-14T10:26:36,862 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml' 2026-02-14T10:26:36,864 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml' 2026-02-14T10:26:36,865 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml' 2026-02-14T10:26:36,866 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml' 2026-02-14T10:26:36,868 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml' 2026-02-14T10:26:36,869 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml' 2026-02-14T10:26:36,870 adding 'lm_eval/tasks/afrobench/sib/prompt_4/utils.py' 2026-02-14T10:26:36,872 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib' 2026-02-14T10:26:36,874 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml' 2026-02-14T10:26:36,875 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml' 2026-02-14T10:26:36,876 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml' 2026-02-14T10:26:36,878 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml' 2026-02-14T10:26:36,879 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml' 2026-02-14T10:26:36,880 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml' 2026-02-14T10:26:36,881 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml' 2026-02-14T10:26:36,882 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml' 2026-02-14T10:26:36,884 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml' 2026-02-14T10:26:36,885 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml' 2026-02-14T10:26:36,886 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml' 2026-02-14T10:26:36,888 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml' 2026-02-14T10:26:36,889 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml' 2026-02-14T10:26:36,890 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml' 2026-02-14T10:26:36,891 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml' 2026-02-14T10:26:36,893 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml' 2026-02-14T10:26:36,894 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml' 2026-02-14T10:26:36,895 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml' 2026-02-14T10:26:36,897 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml' 2026-02-14T10:26:36,898 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml' 2026-02-14T10:26:36,899 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml' 2026-02-14T10:26:36,900 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml' 2026-02-14T10:26:36,902 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml' 2026-02-14T10:26:36,903 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml' 2026-02-14T10:26:36,904 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml' 2026-02-14T10:26:36,906 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml' 2026-02-14T10:26:36,907 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml' 2026-02-14T10:26:36,908 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml' 2026-02-14T10:26:36,910 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml' 2026-02-14T10:26:36,911 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml' 2026-02-14T10:26:36,912 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml' 2026-02-14T10:26:36,913 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml' 2026-02-14T10:26:36,914 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml' 2026-02-14T10:26:36,915 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml' 2026-02-14T10:26:36,917 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml' 2026-02-14T10:26:36,918 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml' 2026-02-14T10:26:36,919 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml' 2026-02-14T10:26:36,920 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml' 2026-02-14T10:26:36,921 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml' 2026-02-14T10:26:36,922 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml' 2026-02-14T10:26:36,924 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml' 2026-02-14T10:26:36,925 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml' 2026-02-14T10:26:36,926 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml' 2026-02-14T10:26:36,928 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml' 2026-02-14T10:26:36,929 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml' 2026-02-14T10:26:36,930 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml' 2026-02-14T10:26:36,932 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml' 2026-02-14T10:26:36,933 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml' 2026-02-14T10:26:36,935 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml' 2026-02-14T10:26:36,936 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml' 2026-02-14T10:26:36,937 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml' 2026-02-14T10:26:36,938 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml' 2026-02-14T10:26:36,940 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml' 2026-02-14T10:26:36,941 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml' 2026-02-14T10:26:36,943 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml' 2026-02-14T10:26:36,944 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml' 2026-02-14T10:26:36,946 adding 'lm_eval/tasks/afrobench/sib/prompt_5/utils.py' 2026-02-14T10:26:36,948 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/README.md' 2026-02-14T10:26:36,949 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml' 2026-02-14T10:26:36,950 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/utils.py' 2026-02-14T10:26:36,952 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy' 2026-02-14T10:26:36,954 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml' 2026-02-14T10:26:36,955 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml' 2026-02-14T10:26:36,956 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml' 2026-02-14T10:26:36,957 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml' 2026-02-14T10:26:36,958 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml' 2026-02-14T10:26:36,960 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml' 2026-02-14T10:26:36,961 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml' 2026-02-14T10:26:36,962 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py' 2026-02-14T10:26:36,964 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy' 2026-02-14T10:26:36,966 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml' 2026-02-14T10:26:36,967 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml' 2026-02-14T10:26:36,968 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml' 2026-02-14T10:26:36,969 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml' 2026-02-14T10:26:36,970 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml' 2026-02-14T10:26:36,972 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml' 2026-02-14T10:26:36,973 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml' 2026-02-14T10:26:36,974 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py' 2026-02-14T10:26:36,976 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy' 2026-02-14T10:26:36,977 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml' 2026-02-14T10:26:36,978 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml' 2026-02-14T10:26:36,979 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml' 2026-02-14T10:26:36,981 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml' 2026-02-14T10:26:36,982 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml' 2026-02-14T10:26:36,983 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml' 2026-02-14T10:26:36,984 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml' 2026-02-14T10:26:36,986 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py' 2026-02-14T10:26:36,987 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy' 2026-02-14T10:26:36,989 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml' 2026-02-14T10:26:36,990 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml' 2026-02-14T10:26:36,991 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml' 2026-02-14T10:26:36,992 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml' 2026-02-14T10:26:36,994 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml' 2026-02-14T10:26:36,995 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml' 2026-02-14T10:26:36,996 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml' 2026-02-14T10:26:36,997 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py' 2026-02-14T10:26:36,999 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy' 2026-02-14T10:26:37,001 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml' 2026-02-14T10:26:37,002 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml' 2026-02-14T10:26:37,003 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml' 2026-02-14T10:26:37,004 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml' 2026-02-14T10:26:37,006 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml' 2026-02-14T10:26:37,007 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml' 2026-02-14T10:26:37,008 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml' 2026-02-14T10:26:37,009 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py' 2026-02-14T10:26:37,011 adding 'lm_eval/tasks/afrobench/xlsum/README.md' 2026-02-14T10:26:37,013 adding 'lm_eval/tasks/afrobench/xlsum/utils.py' 2026-02-14T10:26:37,014 adding 'lm_eval/tasks/afrobench/xlsum/xlsum.yaml' 2026-02-14T10:26:37,016 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py' 2026-02-14T10:26:37,017 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum' 2026-02-14T10:26:37,018 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml' 2026-02-14T10:26:37,019 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml' 2026-02-14T10:26:37,021 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml' 2026-02-14T10:26:37,022 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml' 2026-02-14T10:26:37,023 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml' 2026-02-14T10:26:37,024 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml' 2026-02-14T10:26:37,026 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml' 2026-02-14T10:26:37,027 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml' 2026-02-14T10:26:37,028 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml' 2026-02-14T10:26:37,029 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml' 2026-02-14T10:26:37,030 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml' 2026-02-14T10:26:37,031 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml' 2026-02-14T10:26:37,033 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py' 2026-02-14T10:26:37,034 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum' 2026-02-14T10:26:37,036 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml' 2026-02-14T10:26:37,037 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml' 2026-02-14T10:26:37,038 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml' 2026-02-14T10:26:37,039 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml' 2026-02-14T10:26:37,041 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml' 2026-02-14T10:26:37,042 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml' 2026-02-14T10:26:37,043 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml' 2026-02-14T10:26:37,044 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml' 2026-02-14T10:26:37,046 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml' 2026-02-14T10:26:37,047 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml' 2026-02-14T10:26:37,048 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml' 2026-02-14T10:26:37,049 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml' 2026-02-14T10:26:37,051 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py' 2026-02-14T10:26:37,053 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum' 2026-02-14T10:26:37,054 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml' 2026-02-14T10:26:37,055 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml' 2026-02-14T10:26:37,056 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml' 2026-02-14T10:26:37,057 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml' 2026-02-14T10:26:37,059 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml' 2026-02-14T10:26:37,060 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml' 2026-02-14T10:26:37,061 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml' 2026-02-14T10:26:37,062 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml' 2026-02-14T10:26:37,063 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml' 2026-02-14T10:26:37,065 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml' 2026-02-14T10:26:37,066 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml' 2026-02-14T10:26:37,067 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml' 2026-02-14T10:26:37,070 adding 'lm_eval/tasks/agieval/README.md' 2026-02-14T10:26:37,071 adding 'lm_eval/tasks/agieval/agieval.yaml' 2026-02-14T10:26:37,072 adding 'lm_eval/tasks/agieval/agieval_cn.yaml' 2026-02-14T10:26:37,074 adding 'lm_eval/tasks/agieval/agieval_en.yaml' 2026-02-14T10:26:37,075 adding 'lm_eval/tasks/agieval/agieval_nous.yaml' 2026-02-14T10:26:37,076 adding 'lm_eval/tasks/agieval/aqua-rat.yaml' 2026-02-14T10:26:37,077 adding 'lm_eval/tasks/agieval/gaokao-biology.yaml' 2026-02-14T10:26:37,078 adding 'lm_eval/tasks/agieval/gaokao-chemistry.yaml' 2026-02-14T10:26:37,080 adding 'lm_eval/tasks/agieval/gaokao-chinese.yaml' 2026-02-14T10:26:37,081 adding 'lm_eval/tasks/agieval/gaokao-english.yaml' 2026-02-14T10:26:37,082 adding 'lm_eval/tasks/agieval/gaokao-geography.yaml' 2026-02-14T10:26:37,083 adding 'lm_eval/tasks/agieval/gaokao-history.yaml' 2026-02-14T10:26:37,084 adding 'lm_eval/tasks/agieval/gaokao-mathcloze.yaml' 2026-02-14T10:26:37,085 adding 'lm_eval/tasks/agieval/gaokao-mathqa.yaml' 2026-02-14T10:26:37,087 adding 'lm_eval/tasks/agieval/gaokao-physics.yaml' 2026-02-14T10:26:37,088 adding 'lm_eval/tasks/agieval/jec-qa-ca.yaml' 2026-02-14T10:26:37,089 adding 'lm_eval/tasks/agieval/jec-qa-kd.yaml' 2026-02-14T10:26:37,090 adding 'lm_eval/tasks/agieval/logiqa-en.yaml' 2026-02-14T10:26:37,091 adding 'lm_eval/tasks/agieval/logiqa-zh.yaml' 2026-02-14T10:26:37,092 adding 'lm_eval/tasks/agieval/lsat-ar.yaml' 2026-02-14T10:26:37,093 adding 'lm_eval/tasks/agieval/lsat-lr.yaml' 2026-02-14T10:26:37,094 adding 'lm_eval/tasks/agieval/lsat-rc.yaml' 2026-02-14T10:26:37,095 adding 'lm_eval/tasks/agieval/math.yaml' 2026-02-14T10:26:37,096 adding 'lm_eval/tasks/agieval/sat-en-without-passage.yaml' 2026-02-14T10:26:37,098 adding 'lm_eval/tasks/agieval/sat-en.yaml' 2026-02-14T10:26:37,099 adding 'lm_eval/tasks/agieval/sat-math.yaml' 2026-02-14T10:26:37,100 adding 'lm_eval/tasks/agieval/utils.py' 2026-02-14T10:26:37,102 adding 'lm_eval/tasks/aime/README.md' 2026-02-14T10:26:37,103 adding 'lm_eval/tasks/aime/aime.yaml' 2026-02-14T10:26:37,104 adding 'lm_eval/tasks/aime/aime24.yaml' 2026-02-14T10:26:37,106 adding 'lm_eval/tasks/aime/aime25.yaml' 2026-02-14T10:26:37,107 adding 'lm_eval/tasks/aime/utils.py' 2026-02-14T10:26:37,110 adding 'lm_eval/tasks/alghafa/copa_ar/README.md' 2026-02-14T10:26:37,111 adding 'lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml' 2026-02-14T10:26:37,113 adding 'lm_eval/tasks/alghafa/piqa_ar/README.md' 2026-02-14T10:26:37,114 adding 'lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml' 2026-02-14T10:26:37,116 adding 'lm_eval/tasks/anli/README.md' 2026-02-14T10:26:37,117 adding 'lm_eval/tasks/anli/anli_r1.yaml' 2026-02-14T10:26:37,118 adding 'lm_eval/tasks/anli/anli_r2.yaml' 2026-02-14T10:26:37,119 adding 'lm_eval/tasks/anli/anli_r3.yaml' 2026-02-14T10:26:37,122 adding 'lm_eval/tasks/arab_culture/README.md' 2026-02-14T10:26:37,123 adding 'lm_eval/tasks/arab_culture/_arab_culture.yaml' 2026-02-14T10:26:37,124 adding 'lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml' 2026-02-14T10:26:37,125 adding 'lm_eval/tasks/arab_culture/_arab_culture_levant.yaml' 2026-02-14T10:26:37,126 adding 'lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml' 2026-02-14T10:26:37,128 adding 'lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml' 2026-02-14T10:26:37,129 adding 'lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml' 2026-02-14T10:26:37,130 adding 'lm_eval/tasks/arab_culture/_generate_configs.py' 2026-02-14T10:26:37,131 adding 'lm_eval/tasks/arab_culture/arab_culture_algeria.yaml' 2026-02-14T10:26:37,133 adding 'lm_eval/tasks/arab_culture/arab_culture_egypt.yaml' 2026-02-14T10:26:37,134 adding 'lm_eval/tasks/arab_culture/arab_culture_jordan.yaml' 2026-02-14T10:26:37,135 adding 'lm_eval/tasks/arab_culture/arab_culture_ksa.yaml' 2026-02-14T10:26:37,136 adding 'lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml' 2026-02-14T10:26:37,137 adding 'lm_eval/tasks/arab_culture/arab_culture_libya.yaml' 2026-02-14T10:26:37,138 adding 'lm_eval/tasks/arab_culture/arab_culture_morocco.yaml' 2026-02-14T10:26:37,140 adding 'lm_eval/tasks/arab_culture/arab_culture_palestine.yaml' 2026-02-14T10:26:37,141 adding 'lm_eval/tasks/arab_culture/arab_culture_sudan.yaml' 2026-02-14T10:26:37,142 adding 'lm_eval/tasks/arab_culture/arab_culture_syria.yaml' 2026-02-14T10:26:37,143 adding 'lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml' 2026-02-14T10:26:37,144 adding 'lm_eval/tasks/arab_culture/arab_culture_uae.yaml' 2026-02-14T10:26:37,146 adding 'lm_eval/tasks/arab_culture/arab_culture_yemen.yaml' 2026-02-14T10:26:37,147 adding 'lm_eval/tasks/arab_culture/prompts.py' 2026-02-14T10:26:37,149 adding 'lm_eval/tasks/arab_culture/utils_mcq.py' 2026-02-14T10:26:37,151 adding 'lm_eval/tasks/arab_culture_completion/README.md' 2026-02-14T10:26:37,153 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml' 2026-02-14T10:26:37,154 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml' 2026-02-14T10:26:37,155 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml' 2026-02-14T10:26:37,156 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml' 2026-02-14T10:26:37,158 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml' 2026-02-14T10:26:37,159 adding 'lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml' 2026-02-14T10:26:37,160 adding 'lm_eval/tasks/arab_culture_completion/_generate_configs.py' 2026-02-14T10:26:37,161 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml' 2026-02-14T10:26:37,162 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml' 2026-02-14T10:26:37,163 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml' 2026-02-14T10:26:37,165 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml' 2026-02-14T10:26:37,166 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml' 2026-02-14T10:26:37,167 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml' 2026-02-14T10:26:37,169 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml' 2026-02-14T10:26:37,170 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml' 2026-02-14T10:26:37,171 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml' 2026-02-14T10:26:37,172 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml' 2026-02-14T10:26:37,173 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml' 2026-02-14T10:26:37,175 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml' 2026-02-14T10:26:37,176 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml' 2026-02-14T10:26:37,178 adding 'lm_eval/tasks/arab_culture_completion/prompts.py' 2026-02-14T10:26:37,179 adding 'lm_eval/tasks/arab_culture_completion/utils_completion.py' 2026-02-14T10:26:37,182 adding 'lm_eval/tasks/arabic_leaderboard_complete/README.md' 2026-02-14T10:26:37,183 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml' 2026-02-14T10:26:37,185 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml' 2026-02-14T10:26:37,187 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml' 2026-02-14T10:26:37,188 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml' 2026-02-14T10:26:37,189 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml' 2026-02-14T10:26:37,190 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml' 2026-02-14T10:26:37,192 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml' 2026-02-14T10:26:37,193 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml' 2026-02-14T10:26:37,194 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml' 2026-02-14T10:26:37,196 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml' 2026-02-14T10:26:37,197 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml' 2026-02-14T10:26:37,198 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py' 2026-02-14T10:26:37,200 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml' 2026-02-14T10:26:37,201 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml' 2026-02-14T10:26:37,202 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py' 2026-02-14T10:26:37,205 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml' 2026-02-14T10:26:37,206 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml' 2026-02-14T10:26:37,207 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml' 2026-02-14T10:26:37,209 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml' 2026-02-14T10:26:37,210 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml' 2026-02-14T10:26:37,211 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:37,212 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml' 2026-02-14T10:26:37,214 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml' 2026-02-14T10:26:37,215 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml' 2026-02-14T10:26:37,216 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml' 2026-02-14T10:26:37,217 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml' 2026-02-14T10:26:37,218 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml' 2026-02-14T10:26:37,220 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml' 2026-02-14T10:26:37,221 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml' 2026-02-14T10:26:37,222 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml' 2026-02-14T10:26:37,223 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml' 2026-02-14T10:26:37,225 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:37,226 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml' 2026-02-14T10:26:37,227 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml' 2026-02-14T10:26:37,229 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml' 2026-02-14T10:26:37,230 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:37,231 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:37,232 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml' 2026-02-14T10:26:37,234 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml' 2026-02-14T10:26:37,235 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:37,236 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:37,237 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:37,238 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:37,240 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml' 2026-02-14T10:26:37,241 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml' 2026-02-14T10:26:37,242 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml' 2026-02-14T10:26:37,243 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml' 2026-02-14T10:26:37,244 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml' 2026-02-14T10:26:37,246 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml' 2026-02-14T10:26:37,247 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml' 2026-02-14T10:26:37,248 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml' 2026-02-14T10:26:37,249 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml' 2026-02-14T10:26:37,250 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml' 2026-02-14T10:26:37,252 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml' 2026-02-14T10:26:37,253 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml' 2026-02-14T10:26:37,254 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml' 2026-02-14T10:26:37,255 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml' 2026-02-14T10:26:37,257 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml' 2026-02-14T10:26:37,258 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml' 2026-02-14T10:26:37,259 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml' 2026-02-14T10:26:37,260 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml' 2026-02-14T10:26:37,262 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml' 2026-02-14T10:26:37,263 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml' 2026-02-14T10:26:37,264 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml' 2026-02-14T10:26:37,265 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml' 2026-02-14T10:26:37,266 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml' 2026-02-14T10:26:37,267 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml' 2026-02-14T10:26:37,269 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml' 2026-02-14T10:26:37,270 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml' 2026-02-14T10:26:37,271 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml' 2026-02-14T10:26:37,272 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:37,274 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml' 2026-02-14T10:26:37,275 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml' 2026-02-14T10:26:37,276 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py' 2026-02-14T10:26:37,278 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml' 2026-02-14T10:26:37,279 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml' 2026-02-14T10:26:37,280 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py' 2026-02-14T10:26:37,282 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml' 2026-02-14T10:26:37,283 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml' 2026-02-14T10:26:37,284 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py' 2026-02-14T10:26:37,286 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml' 2026-02-14T10:26:37,287 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml' 2026-02-14T10:26:37,289 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py' 2026-02-14T10:26:37,290 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml' 2026-02-14T10:26:37,292 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml' 2026-02-14T10:26:37,293 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py' 2026-02-14T10:26:37,295 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml' 2026-02-14T10:26:37,296 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml' 2026-02-14T10:26:37,297 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py' 2026-02-14T10:26:37,299 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml' 2026-02-14T10:26:37,300 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml' 2026-02-14T10:26:37,302 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py' 2026-02-14T10:26:37,303 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml' 2026-02-14T10:26:37,304 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml' 2026-02-14T10:26:37,306 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py' 2026-02-14T10:26:37,307 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml' 2026-02-14T10:26:37,308 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml' 2026-02-14T10:26:37,310 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py' 2026-02-14T10:26:37,311 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml' 2026-02-14T10:26:37,313 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml' 2026-02-14T10:26:37,314 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py' 2026-02-14T10:26:37,316 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml' 2026-02-14T10:26:37,317 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml' 2026-02-14T10:26:37,318 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py' 2026-02-14T10:26:37,320 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml' 2026-02-14T10:26:37,321 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml' 2026-02-14T10:26:37,322 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py' 2026-02-14T10:26:37,325 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml' 2026-02-14T10:26:37,326 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml' 2026-02-14T10:26:37,328 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml' 2026-02-14T10:26:37,329 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml' 2026-02-14T10:26:37,330 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml' 2026-02-14T10:26:37,331 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml' 2026-02-14T10:26:37,333 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml' 2026-02-14T10:26:37,334 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml' 2026-02-14T10:26:37,335 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml' 2026-02-14T10:26:37,336 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml' 2026-02-14T10:26:37,338 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml' 2026-02-14T10:26:37,339 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml' 2026-02-14T10:26:37,340 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml' 2026-02-14T10:26:37,341 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml' 2026-02-14T10:26:37,343 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml' 2026-02-14T10:26:37,344 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml' 2026-02-14T10:26:37,345 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml' 2026-02-14T10:26:37,346 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml' 2026-02-14T10:26:37,347 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml' 2026-02-14T10:26:37,349 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml' 2026-02-14T10:26:37,350 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml' 2026-02-14T10:26:37,351 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml' 2026-02-14T10:26:37,352 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml' 2026-02-14T10:26:37,354 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml' 2026-02-14T10:26:37,355 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml' 2026-02-14T10:26:37,356 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml' 2026-02-14T10:26:37,357 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml' 2026-02-14T10:26:37,358 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml' 2026-02-14T10:26:37,360 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml' 2026-02-14T10:26:37,361 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml' 2026-02-14T10:26:37,362 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml' 2026-02-14T10:26:37,364 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml' 2026-02-14T10:26:37,365 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml' 2026-02-14T10:26:37,366 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml' 2026-02-14T10:26:37,367 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml' 2026-02-14T10:26:37,369 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml' 2026-02-14T10:26:37,370 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml' 2026-02-14T10:26:37,371 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml' 2026-02-14T10:26:37,372 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml' 2026-02-14T10:26:37,374 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml' 2026-02-14T10:26:37,375 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml' 2026-02-14T10:26:37,376 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml' 2026-02-14T10:26:37,378 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml' 2026-02-14T10:26:37,379 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml' 2026-02-14T10:26:37,380 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml' 2026-02-14T10:26:37,381 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml' 2026-02-14T10:26:37,382 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml' 2026-02-14T10:26:37,383 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml' 2026-02-14T10:26:37,385 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml' 2026-02-14T10:26:37,386 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml' 2026-02-14T10:26:37,387 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml' 2026-02-14T10:26:37,388 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml' 2026-02-14T10:26:37,389 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml' 2026-02-14T10:26:37,391 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml' 2026-02-14T10:26:37,392 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml' 2026-02-14T10:26:37,393 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml' 2026-02-14T10:26:37,394 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml' 2026-02-14T10:26:37,395 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml' 2026-02-14T10:26:37,397 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml' 2026-02-14T10:26:37,398 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py' 2026-02-14T10:26:37,400 adding 'lm_eval/tasks/arabic_leaderboard_light/README.md' 2026-02-14T10:26:37,401 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml' 2026-02-14T10:26:37,403 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml' 2026-02-14T10:26:37,404 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml' 2026-02-14T10:26:37,406 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml' 2026-02-14T10:26:37,407 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml' 2026-02-14T10:26:37,408 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml' 2026-02-14T10:26:37,410 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml' 2026-02-14T10:26:37,411 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml' 2026-02-14T10:26:37,412 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml' 2026-02-14T10:26:37,414 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml' 2026-02-14T10:26:37,415 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml' 2026-02-14T10:26:37,416 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py' 2026-02-14T10:26:37,418 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml' 2026-02-14T10:26:37,419 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml' 2026-02-14T10:26:37,420 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py' 2026-02-14T10:26:37,423 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml' 2026-02-14T10:26:37,425 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml' 2026-02-14T10:26:37,426 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml' 2026-02-14T10:26:37,427 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml' 2026-02-14T10:26:37,428 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml' 2026-02-14T10:26:37,429 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml' 2026-02-14T10:26:37,431 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml' 2026-02-14T10:26:37,432 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml' 2026-02-14T10:26:37,433 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml' 2026-02-14T10:26:37,434 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml' 2026-02-14T10:26:37,435 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml' 2026-02-14T10:26:37,436 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml' 2026-02-14T10:26:37,438 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml' 2026-02-14T10:26:37,439 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml' 2026-02-14T10:26:37,440 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml' 2026-02-14T10:26:37,441 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml' 2026-02-14T10:26:37,443 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml' 2026-02-14T10:26:37,444 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml' 2026-02-14T10:26:37,445 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml' 2026-02-14T10:26:37,446 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml' 2026-02-14T10:26:37,448 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml' 2026-02-14T10:26:37,449 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml' 2026-02-14T10:26:37,450 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml' 2026-02-14T10:26:37,451 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml' 2026-02-14T10:26:37,453 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml' 2026-02-14T10:26:37,454 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml' 2026-02-14T10:26:37,455 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml' 2026-02-14T10:26:37,456 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml' 2026-02-14T10:26:37,457 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml' 2026-02-14T10:26:37,459 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml' 2026-02-14T10:26:37,460 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml' 2026-02-14T10:26:37,461 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml' 2026-02-14T10:26:37,462 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml' 2026-02-14T10:26:37,464 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml' 2026-02-14T10:26:37,465 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml' 2026-02-14T10:26:37,466 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml' 2026-02-14T10:26:37,468 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml' 2026-02-14T10:26:37,469 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml' 2026-02-14T10:26:37,471 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml' 2026-02-14T10:26:37,472 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml' 2026-02-14T10:26:37,473 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml' 2026-02-14T10:26:37,475 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml' 2026-02-14T10:26:37,476 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml' 2026-02-14T10:26:37,477 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml' 2026-02-14T10:26:37,478 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml' 2026-02-14T10:26:37,480 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml' 2026-02-14T10:26:37,481 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml' 2026-02-14T10:26:37,482 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml' 2026-02-14T10:26:37,483 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml' 2026-02-14T10:26:37,485 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml' 2026-02-14T10:26:37,486 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml' 2026-02-14T10:26:37,487 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml' 2026-02-14T10:26:37,488 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml' 2026-02-14T10:26:37,489 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml' 2026-02-14T10:26:37,491 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml' 2026-02-14T10:26:37,492 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml' 2026-02-14T10:26:37,493 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml' 2026-02-14T10:26:37,494 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml' 2026-02-14T10:26:37,496 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py' 2026-02-14T10:26:37,498 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml' 2026-02-14T10:26:37,499 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml' 2026-02-14T10:26:37,500 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py' 2026-02-14T10:26:37,502 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml' 2026-02-14T10:26:37,503 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml' 2026-02-14T10:26:37,505 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py' 2026-02-14T10:26:37,507 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml' 2026-02-14T10:26:37,508 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml' 2026-02-14T10:26:37,509 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py' 2026-02-14T10:26:37,511 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml' 2026-02-14T10:26:37,512 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml' 2026-02-14T10:26:37,513 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py' 2026-02-14T10:26:37,515 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml' 2026-02-14T10:26:37,516 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml' 2026-02-14T10:26:37,517 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py' 2026-02-14T10:26:37,519 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml' 2026-02-14T10:26:37,520 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml' 2026-02-14T10:26:37,521 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py' 2026-02-14T10:26:37,523 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml' 2026-02-14T10:26:37,524 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml' 2026-02-14T10:26:37,526 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py' 2026-02-14T10:26:37,528 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml' 2026-02-14T10:26:37,529 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml' 2026-02-14T10:26:37,530 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py' 2026-02-14T10:26:37,532 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml' 2026-02-14T10:26:37,533 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml' 2026-02-14T10:26:37,535 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py' 2026-02-14T10:26:37,537 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml' 2026-02-14T10:26:37,538 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml' 2026-02-14T10:26:37,540 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py' 2026-02-14T10:26:37,542 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml' 2026-02-14T10:26:37,543 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml' 2026-02-14T10:26:37,544 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py' 2026-02-14T10:26:37,548 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml' 2026-02-14T10:26:37,549 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml' 2026-02-14T10:26:37,550 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml' 2026-02-14T10:26:37,552 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml' 2026-02-14T10:26:37,553 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml' 2026-02-14T10:26:37,554 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml' 2026-02-14T10:26:37,555 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml' 2026-02-14T10:26:37,557 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml' 2026-02-14T10:26:37,558 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml' 2026-02-14T10:26:37,559 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml' 2026-02-14T10:26:37,560 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml' 2026-02-14T10:26:37,561 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml' 2026-02-14T10:26:37,562 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml' 2026-02-14T10:26:37,564 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml' 2026-02-14T10:26:37,565 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml' 2026-02-14T10:26:37,567 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml' 2026-02-14T10:26:37,568 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml' 2026-02-14T10:26:37,569 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml' 2026-02-14T10:26:37,570 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml' 2026-02-14T10:26:37,571 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml' 2026-02-14T10:26:37,573 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml' 2026-02-14T10:26:37,574 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml' 2026-02-14T10:26:37,575 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml' 2026-02-14T10:26:37,576 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml' 2026-02-14T10:26:37,578 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml' 2026-02-14T10:26:37,579 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml' 2026-02-14T10:26:37,580 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml' 2026-02-14T10:26:37,582 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml' 2026-02-14T10:26:37,583 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml' 2026-02-14T10:26:37,584 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml' 2026-02-14T10:26:37,586 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml' 2026-02-14T10:26:37,587 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml' 2026-02-14T10:26:37,588 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml' 2026-02-14T10:26:37,590 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml' 2026-02-14T10:26:37,591 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml' 2026-02-14T10:26:37,593 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml' 2026-02-14T10:26:37,594 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml' 2026-02-14T10:26:37,595 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml' 2026-02-14T10:26:37,596 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml' 2026-02-14T10:26:37,597 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml' 2026-02-14T10:26:37,599 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml' 2026-02-14T10:26:37,600 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml' 2026-02-14T10:26:37,601 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml' 2026-02-14T10:26:37,602 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml' 2026-02-14T10:26:37,603 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml' 2026-02-14T10:26:37,605 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml' 2026-02-14T10:26:37,606 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml' 2026-02-14T10:26:37,607 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml' 2026-02-14T10:26:37,608 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml' 2026-02-14T10:26:37,609 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml' 2026-02-14T10:26:37,610 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml' 2026-02-14T10:26:37,612 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml' 2026-02-14T10:26:37,613 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml' 2026-02-14T10:26:37,614 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml' 2026-02-14T10:26:37,615 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml' 2026-02-14T10:26:37,617 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml' 2026-02-14T10:26:37,618 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml' 2026-02-14T10:26:37,619 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml' 2026-02-14T10:26:37,620 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml' 2026-02-14T10:26:37,622 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py' 2026-02-14T10:26:37,624 adding 'lm_eval/tasks/arabicmmlu/README.md' 2026-02-14T10:26:37,625 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml' 2026-02-14T10:26:37,627 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml' 2026-02-14T10:26:37,628 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml' 2026-02-14T10:26:37,629 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml' 2026-02-14T10:26:37,630 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml' 2026-02-14T10:26:37,631 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml' 2026-02-14T10:26:37,632 adding 'lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml' 2026-02-14T10:26:37,633 adding 'lm_eval/tasks/arabicmmlu/_generate_configs.py' 2026-02-14T10:26:37,635 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml' 2026-02-14T10:26:37,636 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml' 2026-02-14T10:26:37,637 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml' 2026-02-14T10:26:37,638 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml' 2026-02-14T10:26:37,639 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml' 2026-02-14T10:26:37,640 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml' 2026-02-14T10:26:37,641 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml' 2026-02-14T10:26:37,642 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml' 2026-02-14T10:26:37,643 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml' 2026-02-14T10:26:37,644 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml' 2026-02-14T10:26:37,646 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml' 2026-02-14T10:26:37,647 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml' 2026-02-14T10:26:37,648 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml' 2026-02-14T10:26:37,649 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml' 2026-02-14T10:26:37,650 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml' 2026-02-14T10:26:37,651 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml' 2026-02-14T10:26:37,652 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml' 2026-02-14T10:26:37,654 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml' 2026-02-14T10:26:37,655 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml' 2026-02-14T10:26:37,656 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml' 2026-02-14T10:26:37,657 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml' 2026-02-14T10:26:37,658 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml' 2026-02-14T10:26:37,660 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml' 2026-02-14T10:26:37,661 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml' 2026-02-14T10:26:37,662 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml' 2026-02-14T10:26:37,663 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml' 2026-02-14T10:26:37,665 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml' 2026-02-14T10:26:37,666 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml' 2026-02-14T10:26:37,667 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml' 2026-02-14T10:26:37,668 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml' 2026-02-14T10:26:37,669 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml' 2026-02-14T10:26:37,670 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml' 2026-02-14T10:26:37,671 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml' 2026-02-14T10:26:37,672 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml' 2026-02-14T10:26:37,673 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml' 2026-02-14T10:26:37,675 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml' 2026-02-14T10:26:37,676 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml' 2026-02-14T10:26:37,677 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml' 2026-02-14T10:26:37,678 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml' 2026-02-14T10:26:37,679 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml' 2026-02-14T10:26:37,680 adding 'lm_eval/tasks/arabicmmlu/utils.py' 2026-02-14T10:26:37,682 adding 'lm_eval/tasks/aradice/README.md' 2026-02-14T10:26:37,684 adding 'lm_eval/tasks/aradice/aradice.yaml' 2026-02-14T10:26:37,687 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml' 2026-02-14T10:26:37,688 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml' 2026-02-14T10:26:37,689 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml' 2026-02-14T10:26:37,690 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml' 2026-02-14T10:26:37,691 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml' 2026-02-14T10:26:37,692 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml' 2026-02-14T10:26:37,693 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml' 2026-02-14T10:26:37,695 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml' 2026-02-14T10:26:37,696 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml' 2026-02-14T10:26:37,697 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml' 2026-02-14T10:26:37,698 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml' 2026-02-14T10:26:37,699 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml' 2026-02-14T10:26:37,700 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml' 2026-02-14T10:26:37,702 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml' 2026-02-14T10:26:37,703 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml' 2026-02-14T10:26:37,704 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml' 2026-02-14T10:26:37,706 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml' 2026-02-14T10:26:37,707 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml' 2026-02-14T10:26:37,708 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml' 2026-02-14T10:26:37,709 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml' 2026-02-14T10:26:37,711 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml' 2026-02-14T10:26:37,712 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml' 2026-02-14T10:26:37,713 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml' 2026-02-14T10:26:37,715 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml' 2026-02-14T10:26:37,717 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml' 2026-02-14T10:26:37,718 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml' 2026-02-14T10:26:37,719 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml' 2026-02-14T10:26:37,721 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml' 2026-02-14T10:26:37,722 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml' 2026-02-14T10:26:37,723 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml' 2026-02-14T10:26:37,724 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml' 2026-02-14T10:26:37,725 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml' 2026-02-14T10:26:37,727 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml' 2026-02-14T10:26:37,728 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml' 2026-02-14T10:26:37,729 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml' 2026-02-14T10:26:37,730 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml' 2026-02-14T10:26:37,731 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml' 2026-02-14T10:26:37,732 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml' 2026-02-14T10:26:37,734 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml' 2026-02-14T10:26:37,735 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml' 2026-02-14T10:26:37,736 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml' 2026-02-14T10:26:37,737 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml' 2026-02-14T10:26:37,738 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py' 2026-02-14T10:26:37,740 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py' 2026-02-14T10:26:37,743 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml' 2026-02-14T10:26:37,744 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml' 2026-02-14T10:26:37,745 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml' 2026-02-14T10:26:37,746 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml' 2026-02-14T10:26:37,748 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml' 2026-02-14T10:26:37,749 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml' 2026-02-14T10:26:37,750 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml' 2026-02-14T10:26:37,751 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml' 2026-02-14T10:26:37,753 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml' 2026-02-14T10:26:37,754 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml' 2026-02-14T10:26:37,755 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml' 2026-02-14T10:26:37,756 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml' 2026-02-14T10:26:37,758 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml' 2026-02-14T10:26:37,759 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml' 2026-02-14T10:26:37,760 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml' 2026-02-14T10:26:37,761 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml' 2026-02-14T10:26:37,762 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml' 2026-02-14T10:26:37,763 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml' 2026-02-14T10:26:37,765 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml' 2026-02-14T10:26:37,766 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml' 2026-02-14T10:26:37,767 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml' 2026-02-14T10:26:37,768 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml' 2026-02-14T10:26:37,769 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml' 2026-02-14T10:26:37,771 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml' 2026-02-14T10:26:37,772 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml' 2026-02-14T10:26:37,773 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml' 2026-02-14T10:26:37,774 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml' 2026-02-14T10:26:37,775 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml' 2026-02-14T10:26:37,776 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml' 2026-02-14T10:26:37,778 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml' 2026-02-14T10:26:37,779 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml' 2026-02-14T10:26:37,780 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml' 2026-02-14T10:26:37,781 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml' 2026-02-14T10:26:37,782 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml' 2026-02-14T10:26:37,784 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml' 2026-02-14T10:26:37,785 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml' 2026-02-14T10:26:37,786 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml' 2026-02-14T10:26:37,787 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml' 2026-02-14T10:26:37,788 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml' 2026-02-14T10:26:37,789 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml' 2026-02-14T10:26:37,791 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml' 2026-02-14T10:26:37,792 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml' 2026-02-14T10:26:37,793 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py' 2026-02-14T10:26:37,795 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py' 2026-02-14T10:26:37,797 adding 'lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml' 2026-02-14T10:26:37,798 adding 'lm_eval/tasks/aradice/boolq/EGY/metrics.py' 2026-02-14T10:26:37,799 adding 'lm_eval/tasks/aradice/boolq/EGY/utils.py' 2026-02-14T10:26:37,801 adding 'lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml' 2026-02-14T10:26:37,803 adding 'lm_eval/tasks/aradice/boolq/ENG/metrics.py' 2026-02-14T10:26:37,804 adding 'lm_eval/tasks/aradice/boolq/ENG/utils.py' 2026-02-14T10:26:37,805 adding 'lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml' 2026-02-14T10:26:37,807 adding 'lm_eval/tasks/aradice/boolq/LEV/metrics.py' 2026-02-14T10:26:37,808 adding 'lm_eval/tasks/aradice/boolq/LEV/utils.py' 2026-02-14T10:26:37,810 adding 'lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml' 2026-02-14T10:26:37,811 adding 'lm_eval/tasks/aradice/boolq/MSA/metrics.py' 2026-02-14T10:26:37,812 adding 'lm_eval/tasks/aradice/boolq/MSA/utils.py' 2026-02-14T10:26:37,814 adding 'lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml' 2026-02-14T10:26:37,815 adding 'lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml' 2026-02-14T10:26:37,816 adding 'lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml' 2026-02-14T10:26:37,817 adding 'lm_eval/tasks/aradice/cultural-benchmark/metrics.py' 2026-02-14T10:26:37,819 adding 'lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml' 2026-02-14T10:26:37,820 adding 'lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml' 2026-02-14T10:26:37,821 adding 'lm_eval/tasks/aradice/cultural-benchmark/syria.yaml' 2026-02-14T10:26:37,822 adding 'lm_eval/tasks/aradice/cultural-benchmark/utils.py' 2026-02-14T10:26:37,824 adding 'lm_eval/tasks/aradice/openbookqa/metrics.py' 2026-02-14T10:26:37,825 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml' 2026-02-14T10:26:37,826 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml' 2026-02-14T10:26:37,827 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml' 2026-02-14T10:26:37,829 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml' 2026-02-14T10:26:37,830 adding 'lm_eval/tasks/aradice/openbookqa/utils.py' 2026-02-14T10:26:37,831 adding 'lm_eval/tasks/aradice/piqa/metrics.py' 2026-02-14T10:26:37,833 adding 'lm_eval/tasks/aradice/piqa/piqa_egy.yaml' 2026-02-14T10:26:37,834 adding 'lm_eval/tasks/aradice/piqa/piqa_eng.yaml' 2026-02-14T10:26:37,835 adding 'lm_eval/tasks/aradice/piqa/piqa_lev.yaml' 2026-02-14T10:26:37,836 adding 'lm_eval/tasks/aradice/piqa/piqa_msa.yaml' 2026-02-14T10:26:37,838 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py' 2026-02-14T10:26:37,840 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml' 2026-02-14T10:26:37,841 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml' 2026-02-14T10:26:37,842 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml' 2026-02-14T10:26:37,844 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml' 2026-02-14T10:26:37,845 adding 'lm_eval/tasks/aradice/winogrande/metrics.py' 2026-02-14T10:26:37,847 adding 'lm_eval/tasks/aradice/winogrande/utils.py' 2026-02-14T10:26:37,848 adding 'lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml' 2026-02-14T10:26:37,849 adding 'lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml' 2026-02-14T10:26:37,850 adding 'lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml' 2026-02-14T10:26:37,852 adding 'lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml' 2026-02-14T10:26:37,854 adding 'lm_eval/tasks/arc/README.md' 2026-02-14T10:26:37,855 adding 'lm_eval/tasks/arc/arc_challenge.yaml' 2026-02-14T10:26:37,856 adding 'lm_eval/tasks/arc/arc_challenge_chat.yaml' 2026-02-14T10:26:37,857 adding 'lm_eval/tasks/arc/arc_easy.yaml' 2026-02-14T10:26:37,859 adding 'lm_eval/tasks/arc_mt/README.md' 2026-02-14T10:26:37,860 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml' 2026-02-14T10:26:37,862 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml' 2026-02-14T10:26:37,863 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml' 2026-02-14T10:26:37,864 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml' 2026-02-14T10:26:37,865 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml' 2026-02-14T10:26:37,866 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml' 2026-02-14T10:26:37,868 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml' 2026-02-14T10:26:37,869 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml' 2026-02-14T10:26:37,870 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml' 2026-02-14T10:26:37,871 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml' 2026-02-14T10:26:37,872 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml' 2026-02-14T10:26:37,873 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml' 2026-02-14T10:26:37,875 adding 'lm_eval/tasks/arithmetic/README.md' 2026-02-14T10:26:37,876 adding 'lm_eval/tasks/arithmetic/arithmetic_1dc.yaml' 2026-02-14T10:26:37,877 adding 'lm_eval/tasks/arithmetic/arithmetic_2da.yaml' 2026-02-14T10:26:37,878 adding 'lm_eval/tasks/arithmetic/arithmetic_2dm.yaml' 2026-02-14T10:26:37,879 adding 'lm_eval/tasks/arithmetic/arithmetic_2ds.yaml' 2026-02-14T10:26:37,880 adding 'lm_eval/tasks/arithmetic/arithmetic_3da.yaml' 2026-02-14T10:26:37,881 adding 'lm_eval/tasks/arithmetic/arithmetic_3ds.yaml' 2026-02-14T10:26:37,882 adding 'lm_eval/tasks/arithmetic/arithmetic_4da.yaml' 2026-02-14T10:26:37,884 adding 'lm_eval/tasks/arithmetic/arithmetic_4ds.yaml' 2026-02-14T10:26:37,885 adding 'lm_eval/tasks/arithmetic/arithmetic_5da.yaml' 2026-02-14T10:26:37,886 adding 'lm_eval/tasks/arithmetic/arithmetic_5ds.yaml' 2026-02-14T10:26:37,888 adding 'lm_eval/tasks/asdiv/README.md' 2026-02-14T10:26:37,889 adding 'lm_eval/tasks/asdiv/asdiv-cot-llama.yaml' 2026-02-14T10:26:37,890 adding 'lm_eval/tasks/asdiv/default.yaml' 2026-02-14T10:26:37,892 adding 'lm_eval/tasks/babi/README.md' 2026-02-14T10:26:37,893 adding 'lm_eval/tasks/babi/babi.yaml' 2026-02-14T10:26:37,895 adding 'lm_eval/tasks/babilong/README.md' 2026-02-14T10:26:37,897 adding 'lm_eval/tasks/babilong/_babilong_common_yaml' 2026-02-14T10:26:37,898 adding 'lm_eval/tasks/babilong/babilong.yaml' 2026-02-14T10:26:37,899 adding 'lm_eval/tasks/babilong/babilong_longctx.yaml' 2026-02-14T10:26:37,900 adding 'lm_eval/tasks/babilong/babilong_qa1.yaml' 2026-02-14T10:26:37,901 adding 'lm_eval/tasks/babilong/babilong_qa10.yaml' 2026-02-14T10:26:37,903 adding 'lm_eval/tasks/babilong/babilong_qa11.yaml' 2026-02-14T10:26:37,904 adding 'lm_eval/tasks/babilong/babilong_qa12.yaml' 2026-02-14T10:26:37,905 adding 'lm_eval/tasks/babilong/babilong_qa13.yaml' 2026-02-14T10:26:37,906 adding 'lm_eval/tasks/babilong/babilong_qa14.yaml' 2026-02-14T10:26:37,908 adding 'lm_eval/tasks/babilong/babilong_qa15.yaml' 2026-02-14T10:26:37,909 adding 'lm_eval/tasks/babilong/babilong_qa16.yaml' 2026-02-14T10:26:37,910 adding 'lm_eval/tasks/babilong/babilong_qa17.yaml' 2026-02-14T10:26:37,911 adding 'lm_eval/tasks/babilong/babilong_qa18.yaml' 2026-02-14T10:26:37,913 adding 'lm_eval/tasks/babilong/babilong_qa19.yaml' 2026-02-14T10:26:37,914 adding 'lm_eval/tasks/babilong/babilong_qa2.yaml' 2026-02-14T10:26:37,915 adding 'lm_eval/tasks/babilong/babilong_qa20.yaml' 2026-02-14T10:26:37,917 adding 'lm_eval/tasks/babilong/babilong_qa3.yaml' 2026-02-14T10:26:37,918 adding 'lm_eval/tasks/babilong/babilong_qa4.yaml' 2026-02-14T10:26:37,919 adding 'lm_eval/tasks/babilong/babilong_qa5.yaml' 2026-02-14T10:26:37,920 adding 'lm_eval/tasks/babilong/babilong_qa6.yaml' 2026-02-14T10:26:37,922 adding 'lm_eval/tasks/babilong/babilong_qa7.yaml' 2026-02-14T10:26:37,923 adding 'lm_eval/tasks/babilong/babilong_qa8.yaml' 2026-02-14T10:26:37,924 adding 'lm_eval/tasks/babilong/babilong_qa9.yaml' 2026-02-14T10:26:37,926 adding 'lm_eval/tasks/babilong/common_utils.py' 2026-02-14T10:26:37,928 adding 'lm_eval/tasks/bangla/README.md' 2026-02-14T10:26:37,929 adding 'lm_eval/tasks/bangla/bangla_boolqa.yaml' 2026-02-14T10:26:37,930 adding 'lm_eval/tasks/bangla/bangla_commonsenseqa.yaml' 2026-02-14T10:26:37,931 adding 'lm_eval/tasks/bangla/bangla_mmlu.yaml' 2026-02-14T10:26:37,932 adding 'lm_eval/tasks/bangla/bangla_openbookqa.yaml' 2026-02-14T10:26:37,934 adding 'lm_eval/tasks/bangla/bangla_piqa.yaml' 2026-02-14T10:26:37,936 adding 'lm_eval/tasks/basque_bench/README.md' 2026-02-14T10:26:37,937 adding 'lm_eval/tasks/basque_bench/arc_eu_challenge.yaml' 2026-02-14T10:26:37,938 adding 'lm_eval/tasks/basque_bench/arc_eu_easy.yaml' 2026-02-14T10:26:37,939 adding 'lm_eval/tasks/basque_bench/basque_bench.yaml' 2026-02-14T10:26:37,941 adding 'lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml' 2026-02-14T10:26:37,942 adding 'lm_eval/tasks/basque_bench/mgsm_native_cot_eu.yaml' 2026-02-14T10:26:37,943 adding 'lm_eval/tasks/basque_bench/paws_eu.yaml' 2026-02-14T10:26:37,944 adding 'lm_eval/tasks/basque_bench/piqa_eu.yaml' 2026-02-14T10:26:37,945 adding 'lm_eval/tasks/basque_bench/utils.py' 2026-02-14T10:26:37,946 adding 'lm_eval/tasks/basque_bench/wnli_eu.yaml' 2026-02-14T10:26:37,947 adding 'lm_eval/tasks/basque_bench/xcopa_eu.yaml' 2026-02-14T10:26:37,949 adding 'lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml' 2026-02-14T10:26:37,951 adding 'lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py' 2026-02-14T10:26:37,952 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml' 2026-02-14T10:26:37,953 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml' 2026-02-14T10:26:37,954 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml' 2026-02-14T10:26:37,956 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml' 2026-02-14T10:26:37,957 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml' 2026-02-14T10:26:37,958 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml' 2026-02-14T10:26:37,959 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml' 2026-02-14T10:26:37,961 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml' 2026-02-14T10:26:37,962 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml' 2026-02-14T10:26:37,963 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml' 2026-02-14T10:26:37,964 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml' 2026-02-14T10:26:37,965 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml' 2026-02-14T10:26:37,967 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml' 2026-02-14T10:26:37,968 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml' 2026-02-14T10:26:37,969 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml' 2026-02-14T10:26:37,970 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml' 2026-02-14T10:26:37,971 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml' 2026-02-14T10:26:37,973 adding 'lm_eval/tasks/basqueglue/README.md' 2026-02-14T10:26:37,974 adding 'lm_eval/tasks/basqueglue/bec.yaml' 2026-02-14T10:26:37,976 adding 'lm_eval/tasks/basqueglue/bhtc.yaml' 2026-02-14T10:26:37,977 adding 'lm_eval/tasks/basqueglue/coref.yaml' 2026-02-14T10:26:37,978 adding 'lm_eval/tasks/basqueglue/qnli.yaml' 2026-02-14T10:26:37,979 adding 'lm_eval/tasks/basqueglue/utils.py' 2026-02-14T10:26:37,981 adding 'lm_eval/tasks/basqueglue/vaxx.yaml' 2026-02-14T10:26:37,982 adding 'lm_eval/tasks/basqueglue/wic.yaml' 2026-02-14T10:26:37,984 adding 'lm_eval/tasks/bbh/README.md' 2026-02-14T10:26:37,985 adding 'lm_eval/tasks/bbh/_generate_configs.py' 2026-02-14T10:26:37,988 adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml' 2026-02-14T10:26:37,989 adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml' 2026-02-14T10:26:37,990 adding 'lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml' 2026-02-14T10:26:37,992 adding 'lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml' 2026-02-14T10:26:37,993 adding 'lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml' 2026-02-14T10:26:37,995 adding 'lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml' 2026-02-14T10:26:37,997 adding 'lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml' 2026-02-14T10:26:37,998 adding 'lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml' 2026-02-14T10:26:37,999 adding 'lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml' 2026-02-14T10:26:38,001 adding 'lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml' 2026-02-14T10:26:38,002 adding 'lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml' 2026-02-14T10:26:38,004 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml' 2026-02-14T10:26:38,005 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml' 2026-02-14T10:26:38,006 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml' 2026-02-14T10:26:38,008 adding 'lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml' 2026-02-14T10:26:38,009 adding 'lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml' 2026-02-14T10:26:38,010 adding 'lm_eval/tasks/bbh/cot_fewshot/navigate.yaml' 2026-02-14T10:26:38,012 adding 'lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml' 2026-02-14T10:26:38,013 adding 'lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml' 2026-02-14T10:26:38,014 adding 'lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml' 2026-02-14T10:26:38,016 adding 'lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml' 2026-02-14T10:26:38,017 adding 'lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml' 2026-02-14T10:26:38,019 adding 'lm_eval/tasks/bbh/cot_fewshot/snarks.yaml' 2026-02-14T10:26:38,020 adding 'lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml' 2026-02-14T10:26:38,022 adding 'lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml' 2026-02-14T10:26:38,023 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml' 2026-02-14T10:26:38,024 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml' 2026-02-14T10:26:38,025 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml' 2026-02-14T10:26:38,027 adding 'lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml' 2026-02-14T10:26:38,028 adding 'lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml' 2026-02-14T10:26:38,030 adding 'lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml' 2026-02-14T10:26:38,032 adding 'lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml' 2026-02-14T10:26:38,033 adding 'lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml' 2026-02-14T10:26:38,034 adding 'lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml' 2026-02-14T10:26:38,035 adding 'lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml' 2026-02-14T10:26:38,037 adding 'lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml' 2026-02-14T10:26:38,038 adding 'lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml' 2026-02-14T10:26:38,039 adding 'lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml' 2026-02-14T10:26:38,040 adding 'lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml' 2026-02-14T10:26:38,042 adding 'lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml' 2026-02-14T10:26:38,043 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml' 2026-02-14T10:26:38,044 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml' 2026-02-14T10:26:38,045 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml' 2026-02-14T10:26:38,047 adding 'lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml' 2026-02-14T10:26:38,048 adding 'lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml' 2026-02-14T10:26:38,049 adding 'lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml' 2026-02-14T10:26:38,050 adding 'lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml' 2026-02-14T10:26:38,052 adding 'lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml' 2026-02-14T10:26:38,053 adding 'lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml' 2026-02-14T10:26:38,054 adding 'lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml' 2026-02-14T10:26:38,056 adding 'lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml' 2026-02-14T10:26:38,057 adding 'lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml' 2026-02-14T10:26:38,059 adding 'lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml' 2026-02-14T10:26:38,060 adding 'lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml' 2026-02-14T10:26:38,061 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml' 2026-02-14T10:26:38,063 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml' 2026-02-14T10:26:38,065 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml' 2026-02-14T10:26:38,066 adding 'lm_eval/tasks/bbh/cot_zeroshot/utils.py' 2026-02-14T10:26:38,067 adding 'lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml' 2026-02-14T10:26:38,069 adding 'lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml' 2026-02-14T10:26:38,072 adding 'lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml' 2026-02-14T10:26:38,073 adding 'lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml' 2026-02-14T10:26:38,074 adding 'lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml' 2026-02-14T10:26:38,076 adding 'lm_eval/tasks/bbh/fewshot/causal_judgement.yaml' 2026-02-14T10:26:38,077 adding 'lm_eval/tasks/bbh/fewshot/date_understanding.yaml' 2026-02-14T10:26:38,079 adding 'lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml' 2026-02-14T10:26:38,080 adding 'lm_eval/tasks/bbh/fewshot/dyck_languages.yaml' 2026-02-14T10:26:38,082 adding 'lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml' 2026-02-14T10:26:38,084 adding 'lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml' 2026-02-14T10:26:38,085 adding 'lm_eval/tasks/bbh/fewshot/hyperbaton.yaml' 2026-02-14T10:26:38,086 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml' 2026-02-14T10:26:38,087 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml' 2026-02-14T10:26:38,089 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml' 2026-02-14T10:26:38,090 adding 'lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml' 2026-02-14T10:26:38,092 adding 'lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml' 2026-02-14T10:26:38,093 adding 'lm_eval/tasks/bbh/fewshot/navigate.yaml' 2026-02-14T10:26:38,094 adding 'lm_eval/tasks/bbh/fewshot/object_counting.yaml' 2026-02-14T10:26:38,095 adding 'lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml' 2026-02-14T10:26:38,097 adding 'lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml' 2026-02-14T10:26:38,098 adding 'lm_eval/tasks/bbh/fewshot/ruin_names.yaml' 2026-02-14T10:26:38,099 adding 'lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml' 2026-02-14T10:26:38,101 adding 'lm_eval/tasks/bbh/fewshot/snarks.yaml' 2026-02-14T10:26:38,102 adding 'lm_eval/tasks/bbh/fewshot/sports_understanding.yaml' 2026-02-14T10:26:38,104 adding 'lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml' 2026-02-14T10:26:38,105 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml' 2026-02-14T10:26:38,106 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml' 2026-02-14T10:26:38,108 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml' 2026-02-14T10:26:38,109 adding 'lm_eval/tasks/bbh/fewshot/web_of_lies.yaml' 2026-02-14T10:26:38,111 adding 'lm_eval/tasks/bbh/fewshot/word_sorting.yaml' 2026-02-14T10:26:38,114 adding 'lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml' 2026-02-14T10:26:38,116 adding 'lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml' 2026-02-14T10:26:38,117 adding 'lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml' 2026-02-14T10:26:38,119 adding 'lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml' 2026-02-14T10:26:38,121 adding 'lm_eval/tasks/bbh/zeroshot/date_understanding.yaml' 2026-02-14T10:26:38,123 adding 'lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml' 2026-02-14T10:26:38,125 adding 'lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml' 2026-02-14T10:26:38,126 adding 'lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml' 2026-02-14T10:26:38,127 adding 'lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml' 2026-02-14T10:26:38,129 adding 'lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml' 2026-02-14T10:26:38,130 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml' 2026-02-14T10:26:38,131 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml' 2026-02-14T10:26:38,132 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml' 2026-02-14T10:26:38,134 adding 'lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml' 2026-02-14T10:26:38,136 adding 'lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml' 2026-02-14T10:26:38,137 adding 'lm_eval/tasks/bbh/zeroshot/navigate.yaml' 2026-02-14T10:26:38,138 adding 'lm_eval/tasks/bbh/zeroshot/object_counting.yaml' 2026-02-14T10:26:38,139 adding 'lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml' 2026-02-14T10:26:38,141 adding 'lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml' 2026-02-14T10:26:38,142 adding 'lm_eval/tasks/bbh/zeroshot/ruin_names.yaml' 2026-02-14T10:26:38,143 adding 'lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml' 2026-02-14T10:26:38,144 adding 'lm_eval/tasks/bbh/zeroshot/snarks.yaml' 2026-02-14T10:26:38,146 adding 'lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml' 2026-02-14T10:26:38,147 adding 'lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml' 2026-02-14T10:26:38,148 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml' 2026-02-14T10:26:38,150 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml' 2026-02-14T10:26:38,151 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml' 2026-02-14T10:26:38,153 adding 'lm_eval/tasks/bbh/zeroshot/utils.py' 2026-02-14T10:26:38,154 adding 'lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml' 2026-02-14T10:26:38,155 adding 'lm_eval/tasks/bbh/zeroshot/word_sorting.yaml' 2026-02-14T10:26:38,157 adding 'lm_eval/tasks/bbq/README.md' 2026-02-14T10:26:38,159 adding 'lm_eval/tasks/bbq/bbq_generate.yaml' 2026-02-14T10:26:38,160 adding 'lm_eval/tasks/bbq/bbq_generate_ambig.yaml' 2026-02-14T10:26:38,161 adding 'lm_eval/tasks/bbq/bbq_generate_disambig.yaml' 2026-02-14T10:26:38,163 adding 'lm_eval/tasks/bbq/bbq_multiple_choice.yaml' 2026-02-14T10:26:38,164 adding 'lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml' 2026-02-14T10:26:38,165 adding 'lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml' 2026-02-14T10:26:38,167 adding 'lm_eval/tasks/bbq/utils.py' 2026-02-14T10:26:38,170 adding 'lm_eval/tasks/bear/README.md' 2026-02-14T10:26:38,171 adding 'lm_eval/tasks/bear/bear.yaml' 2026-02-14T10:26:38,172 adding 'lm_eval/tasks/bear/bear_big.yaml' 2026-02-14T10:26:38,177 adding 'lm_eval/tasks/belebele/README.md' 2026-02-14T10:26:38,178 adding 'lm_eval/tasks/belebele/_belebele.yaml' 2026-02-14T10:26:38,179 adding 'lm_eval/tasks/belebele/_default_template_yaml' 2026-02-14T10:26:38,181 adding 'lm_eval/tasks/belebele/_generate_configs.py' 2026-02-14T10:26:38,182 adding 'lm_eval/tasks/belebele/belebele_acm_Arab.yaml' 2026-02-14T10:26:38,183 adding 'lm_eval/tasks/belebele/belebele_afr_Latn.yaml' 2026-02-14T10:26:38,184 adding 'lm_eval/tasks/belebele/belebele_als_Latn.yaml' 2026-02-14T10:26:38,185 adding 'lm_eval/tasks/belebele/belebele_amh_Ethi.yaml' 2026-02-14T10:26:38,187 adding 'lm_eval/tasks/belebele/belebele_apc_Arab.yaml' 2026-02-14T10:26:38,188 adding 'lm_eval/tasks/belebele/belebele_arb_Arab.yaml' 2026-02-14T10:26:38,189 adding 'lm_eval/tasks/belebele/belebele_arb_Latn.yaml' 2026-02-14T10:26:38,190 adding 'lm_eval/tasks/belebele/belebele_ars_Arab.yaml' 2026-02-14T10:26:38,192 adding 'lm_eval/tasks/belebele/belebele_ary_Arab.yaml' 2026-02-14T10:26:38,193 adding 'lm_eval/tasks/belebele/belebele_arz_Arab.yaml' 2026-02-14T10:26:38,194 adding 'lm_eval/tasks/belebele/belebele_asm_Beng.yaml' 2026-02-14T10:26:38,195 adding 'lm_eval/tasks/belebele/belebele_azj_Latn.yaml' 2026-02-14T10:26:38,196 adding 'lm_eval/tasks/belebele/belebele_bam_Latn.yaml' 2026-02-14T10:26:38,198 adding 'lm_eval/tasks/belebele/belebele_ben_Beng.yaml' 2026-02-14T10:26:38,199 adding 'lm_eval/tasks/belebele/belebele_ben_Latn.yaml' 2026-02-14T10:26:38,200 adding 'lm_eval/tasks/belebele/belebele_bod_Tibt.yaml' 2026-02-14T10:26:38,201 adding 'lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml' 2026-02-14T10:26:38,202 adding 'lm_eval/tasks/belebele/belebele_cat_Latn.yaml' 2026-02-14T10:26:38,203 adding 'lm_eval/tasks/belebele/belebele_ceb_Latn.yaml' 2026-02-14T10:26:38,204 adding 'lm_eval/tasks/belebele/belebele_ces_Latn.yaml' 2026-02-14T10:26:38,205 adding 'lm_eval/tasks/belebele/belebele_ckb_Arab.yaml' 2026-02-14T10:26:38,207 adding 'lm_eval/tasks/belebele/belebele_dan_Latn.yaml' 2026-02-14T10:26:38,208 adding 'lm_eval/tasks/belebele/belebele_deu_Latn.yaml' 2026-02-14T10:26:38,209 adding 'lm_eval/tasks/belebele/belebele_ell_Grek.yaml' 2026-02-14T10:26:38,210 adding 'lm_eval/tasks/belebele/belebele_eng_Latn.yaml' 2026-02-14T10:26:38,211 adding 'lm_eval/tasks/belebele/belebele_est_Latn.yaml' 2026-02-14T10:26:38,212 adding 'lm_eval/tasks/belebele/belebele_eus_Latn.yaml' 2026-02-14T10:26:38,213 adding 'lm_eval/tasks/belebele/belebele_fin_Latn.yaml' 2026-02-14T10:26:38,214 adding 'lm_eval/tasks/belebele/belebele_fra_Latn.yaml' 2026-02-14T10:26:38,216 adding 'lm_eval/tasks/belebele/belebele_fuv_Latn.yaml' 2026-02-14T10:26:38,217 adding 'lm_eval/tasks/belebele/belebele_gaz_Latn.yaml' 2026-02-14T10:26:38,218 adding 'lm_eval/tasks/belebele/belebele_grn_Latn.yaml' 2026-02-14T10:26:38,220 adding 'lm_eval/tasks/belebele/belebele_guj_Gujr.yaml' 2026-02-14T10:26:38,221 adding 'lm_eval/tasks/belebele/belebele_hat_Latn.yaml' 2026-02-14T10:26:38,223 adding 'lm_eval/tasks/belebele/belebele_hau_Latn.yaml' 2026-02-14T10:26:38,224 adding 'lm_eval/tasks/belebele/belebele_heb_Hebr.yaml' 2026-02-14T10:26:38,225 adding 'lm_eval/tasks/belebele/belebele_hin_Deva.yaml' 2026-02-14T10:26:38,226 adding 'lm_eval/tasks/belebele/belebele_hin_Latn.yaml' 2026-02-14T10:26:38,228 adding 'lm_eval/tasks/belebele/belebele_hrv_Latn.yaml' 2026-02-14T10:26:38,229 adding 'lm_eval/tasks/belebele/belebele_hun_Latn.yaml' 2026-02-14T10:26:38,230 adding 'lm_eval/tasks/belebele/belebele_hye_Armn.yaml' 2026-02-14T10:26:38,231 adding 'lm_eval/tasks/belebele/belebele_ibo_Latn.yaml' 2026-02-14T10:26:38,232 adding 'lm_eval/tasks/belebele/belebele_ilo_Latn.yaml' 2026-02-14T10:26:38,233 adding 'lm_eval/tasks/belebele/belebele_ind_Latn.yaml' 2026-02-14T10:26:38,234 adding 'lm_eval/tasks/belebele/belebele_isl_Latn.yaml' 2026-02-14T10:26:38,236 adding 'lm_eval/tasks/belebele/belebele_ita_Latn.yaml' 2026-02-14T10:26:38,237 adding 'lm_eval/tasks/belebele/belebele_jav_Latn.yaml' 2026-02-14T10:26:38,238 adding 'lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml' 2026-02-14T10:26:38,239 adding 'lm_eval/tasks/belebele/belebele_kac_Latn.yaml' 2026-02-14T10:26:38,240 adding 'lm_eval/tasks/belebele/belebele_kan_Knda.yaml' 2026-02-14T10:26:38,241 adding 'lm_eval/tasks/belebele/belebele_kat_Geor.yaml' 2026-02-14T10:26:38,242 adding 'lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml' 2026-02-14T10:26:38,244 adding 'lm_eval/tasks/belebele/belebele_kea_Latn.yaml' 2026-02-14T10:26:38,245 adding 'lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml' 2026-02-14T10:26:38,246 adding 'lm_eval/tasks/belebele/belebele_khm_Khmr.yaml' 2026-02-14T10:26:38,247 adding 'lm_eval/tasks/belebele/belebele_kin_Latn.yaml' 2026-02-14T10:26:38,249 adding 'lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml' 2026-02-14T10:26:38,250 adding 'lm_eval/tasks/belebele/belebele_kor_Hang.yaml' 2026-02-14T10:26:38,251 adding 'lm_eval/tasks/belebele/belebele_lao_Laoo.yaml' 2026-02-14T10:26:38,252 adding 'lm_eval/tasks/belebele/belebele_lin_Latn.yaml' 2026-02-14T10:26:38,253 adding 'lm_eval/tasks/belebele/belebele_lit_Latn.yaml' 2026-02-14T10:26:38,254 adding 'lm_eval/tasks/belebele/belebele_lug_Latn.yaml' 2026-02-14T10:26:38,256 adding 'lm_eval/tasks/belebele/belebele_luo_Latn.yaml' 2026-02-14T10:26:38,257 adding 'lm_eval/tasks/belebele/belebele_lvs_Latn.yaml' 2026-02-14T10:26:38,258 adding 'lm_eval/tasks/belebele/belebele_mal_Mlym.yaml' 2026-02-14T10:26:38,259 adding 'lm_eval/tasks/belebele/belebele_mar_Deva.yaml' 2026-02-14T10:26:38,260 adding 'lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml' 2026-02-14T10:26:38,262 adding 'lm_eval/tasks/belebele/belebele_mlt_Latn.yaml' 2026-02-14T10:26:38,263 adding 'lm_eval/tasks/belebele/belebele_mri_Latn.yaml' 2026-02-14T10:26:38,264 adding 'lm_eval/tasks/belebele/belebele_mya_Mymr.yaml' 2026-02-14T10:26:38,265 adding 'lm_eval/tasks/belebele/belebele_nld_Latn.yaml' 2026-02-14T10:26:38,266 adding 'lm_eval/tasks/belebele/belebele_nob_Latn.yaml' 2026-02-14T10:26:38,269 adding 'lm_eval/tasks/belebele/belebele_npi_Deva.yaml' 2026-02-14T10:26:38,270 adding 'lm_eval/tasks/belebele/belebele_npi_Latn.yaml' 2026-02-14T10:26:38,271 adding 'lm_eval/tasks/belebele/belebele_nso_Latn.yaml' 2026-02-14T10:26:38,272 adding 'lm_eval/tasks/belebele/belebele_nya_Latn.yaml' 2026-02-14T10:26:38,276 adding 'lm_eval/tasks/belebele/belebele_ory_Orya.yaml' 2026-02-14T10:26:38,277 adding 'lm_eval/tasks/belebele/belebele_pan_Guru.yaml' 2026-02-14T10:26:38,278 adding 'lm_eval/tasks/belebele/belebele_pbt_Arab.yaml' 2026-02-14T10:26:38,279 adding 'lm_eval/tasks/belebele/belebele_pes_Arab.yaml' 2026-02-14T10:26:38,280 adding 'lm_eval/tasks/belebele/belebele_plt_Latn.yaml' 2026-02-14T10:26:38,281 adding 'lm_eval/tasks/belebele/belebele_pol_Latn.yaml' 2026-02-14T10:26:38,282 adding 'lm_eval/tasks/belebele/belebele_por_Latn.yaml' 2026-02-14T10:26:38,283 adding 'lm_eval/tasks/belebele/belebele_ron_Latn.yaml' 2026-02-14T10:26:38,285 adding 'lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml' 2026-02-14T10:26:38,286 adding 'lm_eval/tasks/belebele/belebele_shn_Mymr.yaml' 2026-02-14T10:26:38,287 adding 'lm_eval/tasks/belebele/belebele_sin_Latn.yaml' 2026-02-14T10:26:38,288 adding 'lm_eval/tasks/belebele/belebele_sin_Sinh.yaml' 2026-02-14T10:26:38,289 adding 'lm_eval/tasks/belebele/belebele_slk_Latn.yaml' 2026-02-14T10:26:38,290 adding 'lm_eval/tasks/belebele/belebele_slv_Latn.yaml' 2026-02-14T10:26:38,291 adding 'lm_eval/tasks/belebele/belebele_sna_Latn.yaml' 2026-02-14T10:26:38,292 adding 'lm_eval/tasks/belebele/belebele_snd_Arab.yaml' 2026-02-14T10:26:38,293 adding 'lm_eval/tasks/belebele/belebele_som_Latn.yaml' 2026-02-14T10:26:38,294 adding 'lm_eval/tasks/belebele/belebele_sot_Latn.yaml' 2026-02-14T10:26:38,296 adding 'lm_eval/tasks/belebele/belebele_spa_Latn.yaml' 2026-02-14T10:26:38,297 adding 'lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml' 2026-02-14T10:26:38,298 adding 'lm_eval/tasks/belebele/belebele_ssw_Latn.yaml' 2026-02-14T10:26:38,299 adding 'lm_eval/tasks/belebele/belebele_sun_Latn.yaml' 2026-02-14T10:26:38,300 adding 'lm_eval/tasks/belebele/belebele_swe_Latn.yaml' 2026-02-14T10:26:38,301 adding 'lm_eval/tasks/belebele/belebele_swh_Latn.yaml' 2026-02-14T10:26:38,302 adding 'lm_eval/tasks/belebele/belebele_tam_Taml.yaml' 2026-02-14T10:26:38,304 adding 'lm_eval/tasks/belebele/belebele_tel_Telu.yaml' 2026-02-14T10:26:38,305 adding 'lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml' 2026-02-14T10:26:38,306 adding 'lm_eval/tasks/belebele/belebele_tgl_Latn.yaml' 2026-02-14T10:26:38,307 adding 'lm_eval/tasks/belebele/belebele_tha_Thai.yaml' 2026-02-14T10:26:38,308 adding 'lm_eval/tasks/belebele/belebele_tir_Ethi.yaml' 2026-02-14T10:26:38,310 adding 'lm_eval/tasks/belebele/belebele_tsn_Latn.yaml' 2026-02-14T10:26:38,311 adding 'lm_eval/tasks/belebele/belebele_tso_Latn.yaml' 2026-02-14T10:26:38,312 adding 'lm_eval/tasks/belebele/belebele_tur_Latn.yaml' 2026-02-14T10:26:38,313 adding 'lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml' 2026-02-14T10:26:38,314 adding 'lm_eval/tasks/belebele/belebele_urd_Arab.yaml' 2026-02-14T10:26:38,316 adding 'lm_eval/tasks/belebele/belebele_urd_Latn.yaml' 2026-02-14T10:26:38,317 adding 'lm_eval/tasks/belebele/belebele_uzn_Latn.yaml' 2026-02-14T10:26:38,318 adding 'lm_eval/tasks/belebele/belebele_vie_Latn.yaml' 2026-02-14T10:26:38,319 adding 'lm_eval/tasks/belebele/belebele_war_Latn.yaml' 2026-02-14T10:26:38,320 adding 'lm_eval/tasks/belebele/belebele_wol_Latn.yaml' 2026-02-14T10:26:38,322 adding 'lm_eval/tasks/belebele/belebele_xho_Latn.yaml' 2026-02-14T10:26:38,323 adding 'lm_eval/tasks/belebele/belebele_yor_Latn.yaml' 2026-02-14T10:26:38,324 adding 'lm_eval/tasks/belebele/belebele_zho_Hans.yaml' 2026-02-14T10:26:38,325 adding 'lm_eval/tasks/belebele/belebele_zho_Hant.yaml' 2026-02-14T10:26:38,326 adding 'lm_eval/tasks/belebele/belebele_zsm_Latn.yaml' 2026-02-14T10:26:38,327 adding 'lm_eval/tasks/belebele/belebele_zul_Latn.yaml' 2026-02-14T10:26:38,329 adding 'lm_eval/tasks/benchmarks/README.md' 2026-02-14T10:26:38,330 adding 'lm_eval/tasks/benchmarks/minerva_math.yaml' 2026-02-14T10:26:38,331 adding 'lm_eval/tasks/benchmarks/openllm.yaml' 2026-02-14T10:26:38,332 adding 'lm_eval/tasks/benchmarks/pythia.yaml' 2026-02-14T10:26:38,334 adding 'lm_eval/tasks/benchmarks/t0_eval.yaml' 2026-02-14T10:26:38,335 adding 'lm_eval/tasks/benchmarks/flan/_held_in_template_yaml' 2026-02-14T10:26:38,337 adding 'lm_eval/tasks/benchmarks/flan/flan_held_in.yaml' 2026-02-14T10:26:38,338 adding 'lm_eval/tasks/benchmarks/flan/flan_held_out.yaml' 2026-02-14T10:26:38,340 adding 'lm_eval/tasks/benchmarks/multimedqa/README.md' 2026-02-14T10:26:38,341 adding 'lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml' 2026-02-14T10:26:38,343 adding 'lm_eval/tasks/bertaqa/README.md' 2026-02-14T10:26:38,345 adding 'lm_eval/tasks/bertaqa/_bertaqa_template' 2026-02-14T10:26:38,346 adding 'lm_eval/tasks/bertaqa/bertaqa_en.yaml' 2026-02-14T10:26:38,347 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml' 2026-02-14T10:26:38,348 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml' 2026-02-14T10:26:38,349 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml' 2026-02-14T10:26:38,350 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml' 2026-02-14T10:26:38,352 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml' 2026-02-14T10:26:38,353 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml' 2026-02-14T10:26:38,354 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml' 2026-02-14T10:26:38,355 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml' 2026-02-14T10:26:38,356 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml' 2026-02-14T10:26:38,357 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml' 2026-02-14T10:26:38,359 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml' 2026-02-14T10:26:38,360 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml' 2026-02-14T10:26:38,361 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml' 2026-02-14T10:26:38,362 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml' 2026-02-14T10:26:38,363 adding 'lm_eval/tasks/bertaqa/bertaqa_eu.yaml' 2026-02-14T10:26:38,366 adding 'lm_eval/tasks/bhs/README.md' 2026-02-14T10:26:38,367 adding 'lm_eval/tasks/bhs/_template_yaml' 2026-02-14T10:26:38,368 adding 'lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml' 2026-02-14T10:26:38,369 adding 'lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml' 2026-02-14T10:26:38,370 adding 'lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml' 2026-02-14T10:26:38,372 adding 'lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml' 2026-02-14T10:26:38,373 adding 'lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml' 2026-02-14T10:26:38,374 adding 'lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml' 2026-02-14T10:26:38,375 adding 'lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml' 2026-02-14T10:26:38,376 adding 'lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml' 2026-02-14T10:26:38,378 adding 'lm_eval/tasks/bhs/bhs_basque.yaml' 2026-02-14T10:26:38,379 adding 'lm_eval/tasks/bhs/bhs_hindi.yaml' 2026-02-14T10:26:38,380 adding 'lm_eval/tasks/bhs/bhs_swahili.yaml' 2026-02-14T10:26:38,381 adding 'lm_eval/tasks/bhs/hindi-S_O_V.yaml' 2026-02-14T10:26:38,382 adding 'lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml' 2026-02-14T10:26:38,383 adding 'lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml' 2026-02-14T10:26:38,385 adding 'lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml' 2026-02-14T10:26:38,386 adding 'lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml' 2026-02-14T10:26:38,387 adding 'lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml' 2026-02-14T10:26:38,388 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml' 2026-02-14T10:26:38,390 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml' 2026-02-14T10:26:38,391 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml' 2026-02-14T10:26:38,392 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml' 2026-02-14T10:26:38,393 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml' 2026-02-14T10:26:38,394 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml' 2026-02-14T10:26:38,395 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml' 2026-02-14T10:26:38,396 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml' 2026-02-14T10:26:38,398 adding 'lm_eval/tasks/bigbench/README.md' 2026-02-14T10:26:38,400 adding 'lm_eval/tasks/bigbench/generate_tasks.py' 2026-02-14T10:26:38,401 adding 'lm_eval/tasks/bigbench/generate_until_template_yaml' 2026-02-14T10:26:38,402 adding 'lm_eval/tasks/bigbench/multiple_choice_template_a_yaml' 2026-02-14T10:26:38,403 adding 'lm_eval/tasks/bigbench/multiple_choice_template_b_yaml' 2026-02-14T10:26:38,405 adding 'lm_eval/tasks/bigbench/push_bigbench_dataset.py' 2026-02-14T10:26:38,409 adding 'lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml' 2026-02-14T10:26:38,410 adding 'lm_eval/tasks/bigbench/generate_until/anachronisms.yaml' 2026-02-14T10:26:38,412 adding 'lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml' 2026-02-14T10:26:38,413 adding 'lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml' 2026-02-14T10:26:38,414 adding 'lm_eval/tasks/bigbench/generate_until/arithmetic.yaml' 2026-02-14T10:26:38,415 adding 'lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml' 2026-02-14T10:26:38,417 adding 'lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml' 2026-02-14T10:26:38,418 adding 'lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml' 2026-02-14T10:26:38,420 adding 'lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml' 2026-02-14T10:26:38,421 adding 'lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml' 2026-02-14T10:26:38,423 adding 'lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml' 2026-02-14T10:26:38,424 adding 'lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml' 2026-02-14T10:26:38,425 adding 'lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml' 2026-02-14T10:26:38,426 adding 'lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml' 2026-02-14T10:26:38,427 adding 'lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml' 2026-02-14T10:26:38,428 adding 'lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml' 2026-02-14T10:26:38,429 adding 'lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml' 2026-02-14T10:26:38,431 adding 'lm_eval/tasks/bigbench/generate_until/code_line_description.yaml' 2026-02-14T10:26:38,432 adding 'lm_eval/tasks/bigbench/generate_until/codenames.yaml' 2026-02-14T10:26:38,433 adding 'lm_eval/tasks/bigbench/generate_until/color.yaml' 2026-02-14T10:26:38,434 adding 'lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml' 2026-02-14T10:26:38,435 adding 'lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml' 2026-02-14T10:26:38,437 adding 'lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml' 2026-02-14T10:26:38,438 adding 'lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml' 2026-02-14T10:26:38,439 adding 'lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml' 2026-02-14T10:26:38,440 adding 'lm_eval/tasks/bigbench/generate_until/crass_ai.yaml' 2026-02-14T10:26:38,441 adding 'lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml' 2026-02-14T10:26:38,442 adding 'lm_eval/tasks/bigbench/generate_until/cryptonite.yaml' 2026-02-14T10:26:38,444 adding 'lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml' 2026-02-14T10:26:38,445 adding 'lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml' 2026-02-14T10:26:38,446 adding 'lm_eval/tasks/bigbench/generate_until/date_understanding.yaml' 2026-02-14T10:26:38,447 adding 'lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml' 2026-02-14T10:26:38,448 adding 'lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml' 2026-02-14T10:26:38,449 adding 'lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml' 2026-02-14T10:26:38,450 adding 'lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml' 2026-02-14T10:26:38,451 adding 'lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml' 2026-02-14T10:26:38,453 adding 'lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml' 2026-02-14T10:26:38,454 adding 'lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml' 2026-02-14T10:26:38,455 adding 'lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml' 2026-02-14T10:26:38,456 adding 'lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml' 2026-02-14T10:26:38,458 adding 'lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml' 2026-02-14T10:26:38,459 adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml' 2026-02-14T10:26:38,460 adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml' 2026-02-14T10:26:38,461 adding 'lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml' 2026-02-14T10:26:38,462 adding 'lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml' 2026-02-14T10:26:38,463 adding 'lm_eval/tasks/bigbench/generate_until/fact_checker.yaml' 2026-02-14T10:26:38,465 adding 'lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml' 2026-02-14T10:26:38,466 adding 'lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml' 2026-02-14T10:26:38,467 adding 'lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml' 2026-02-14T10:26:38,468 adding 'lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml' 2026-02-14T10:26:38,469 adding 'lm_eval/tasks/bigbench/generate_until/gem.yaml' 2026-02-14T10:26:38,470 adding 'lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml' 2026-02-14T10:26:38,471 adding 'lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml' 2026-02-14T10:26:38,473 adding 'lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml' 2026-02-14T10:26:38,474 adding 'lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml' 2026-02-14T10:26:38,475 adding 'lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml' 2026-02-14T10:26:38,476 adding 'lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml' 2026-02-14T10:26:38,477 adding 'lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml' 2026-02-14T10:26:38,478 adding 'lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml' 2026-02-14T10:26:38,480 adding 'lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml' 2026-02-14T10:26:38,481 adding 'lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml' 2026-02-14T10:26:38,482 adding 'lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml' 2026-02-14T10:26:38,483 adding 'lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml' 2026-02-14T10:26:38,484 adding 'lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml' 2026-02-14T10:26:38,485 adding 'lm_eval/tasks/bigbench/generate_until/implicatures.yaml' 2026-02-14T10:26:38,486 adding 'lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml' 2026-02-14T10:26:38,488 adding 'lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml' 2026-02-14T10:26:38,489 adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml' 2026-02-14T10:26:38,490 adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml' 2026-02-14T10:26:38,491 adding 'lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml' 2026-02-14T10:26:38,492 adding 'lm_eval/tasks/bigbench/generate_until/irony_identification.yaml' 2026-02-14T10:26:38,493 adding 'lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml' 2026-02-14T10:26:38,494 adding 'lm_eval/tasks/bigbench/generate_until/kannada.yaml' 2026-02-14T10:26:38,496 adding 'lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml' 2026-02-14T10:26:38,497 adding 'lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml' 2026-02-14T10:26:38,498 adding 'lm_eval/tasks/bigbench/generate_until/language_games.yaml' 2026-02-14T10:26:38,499 adding 'lm_eval/tasks/bigbench/generate_until/language_identification.yaml' 2026-02-14T10:26:38,500 adding 'lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml' 2026-02-14T10:26:38,501 adding 'lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml' 2026-02-14T10:26:38,502 adding 'lm_eval/tasks/bigbench/generate_until/list_functions.yaml' 2026-02-14T10:26:38,503 adding 'lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml' 2026-02-14T10:26:38,504 adding 'lm_eval/tasks/bigbench/generate_until/logical_args.yaml' 2026-02-14T10:26:38,506 adding 'lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml' 2026-02-14T10:26:38,507 adding 'lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml' 2026-02-14T10:26:38,508 adding 'lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml' 2026-02-14T10:26:38,509 adding 'lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml' 2026-02-14T10:26:38,510 adding 'lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml' 2026-02-14T10:26:38,511 adding 'lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml' 2026-02-14T10:26:38,513 adding 'lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml' 2026-02-14T10:26:38,514 adding 'lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml' 2026-02-14T10:26:38,515 adding 'lm_eval/tasks/bigbench/generate_until/misconceptions.yaml' 2026-02-14T10:26:38,516 adding 'lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml' 2026-02-14T10:26:38,517 adding 'lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml' 2026-02-14T10:26:38,518 adding 'lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml' 2026-02-14T10:26:38,520 adding 'lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml' 2026-02-14T10:26:38,521 adding 'lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml' 2026-02-14T10:26:38,522 adding 'lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml' 2026-02-14T10:26:38,523 adding 'lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml' 2026-02-14T10:26:38,524 adding 'lm_eval/tasks/bigbench/generate_until/multiemo.yaml' 2026-02-14T10:26:38,525 adding 'lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml' 2026-02-14T10:26:38,527 adding 'lm_eval/tasks/bigbench/generate_until/navigate.yaml' 2026-02-14T10:26:38,528 adding 'lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml' 2026-02-14T10:26:38,529 adding 'lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml' 2026-02-14T10:26:38,530 adding 'lm_eval/tasks/bigbench/generate_until/object_counting.yaml' 2026-02-14T10:26:38,531 adding 'lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml' 2026-02-14T10:26:38,533 adding 'lm_eval/tasks/bigbench/generate_until/operators.yaml' 2026-02-14T10:26:38,534 adding 'lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml' 2026-02-14T10:26:38,535 adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml' 2026-02-14T10:26:38,536 adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml' 2026-02-14T10:26:38,537 adding 'lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml' 2026-02-14T10:26:38,539 adding 'lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml' 2026-02-14T10:26:38,540 adding 'lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml' 2026-02-14T10:26:38,541 adding 'lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml' 2026-02-14T10:26:38,542 adding 'lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml' 2026-02-14T10:26:38,544 adding 'lm_eval/tasks/bigbench/generate_until/physics.yaml' 2026-02-14T10:26:38,545 adding 'lm_eval/tasks/bigbench/generate_until/physics_questions.yaml' 2026-02-14T10:26:38,546 adding 'lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml' 2026-02-14T10:26:38,547 adding 'lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml' 2026-02-14T10:26:38,548 adding 'lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml' 2026-02-14T10:26:38,549 adding 'lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml' 2026-02-14T10:26:38,550 adding 'lm_eval/tasks/bigbench/generate_until/question_selection.yaml' 2026-02-14T10:26:38,551 adding 'lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml' 2026-02-14T10:26:38,552 adding 'lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml' 2026-02-14T10:26:38,554 adding 'lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml' 2026-02-14T10:26:38,555 adding 'lm_eval/tasks/bigbench/generate_until/rephrase.yaml' 2026-02-14T10:26:38,556 adding 'lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml' 2026-02-14T10:26:38,557 adding 'lm_eval/tasks/bigbench/generate_until/ruin_names.yaml' 2026-02-14T10:26:38,558 adding 'lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml' 2026-02-14T10:26:38,559 adding 'lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml' 2026-02-14T10:26:38,560 adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml' 2026-02-14T10:26:38,562 adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml' 2026-02-14T10:26:38,563 adding 'lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml' 2026-02-14T10:26:38,564 adding 'lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml' 2026-02-14T10:26:38,565 adding 'lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml' 2026-02-14T10:26:38,566 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml' 2026-02-14T10:26:38,567 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml' 2026-02-14T10:26:38,568 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml' 2026-02-14T10:26:38,570 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml' 2026-02-14T10:26:38,571 adding 'lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml' 2026-02-14T10:26:38,572 adding 'lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml' 2026-02-14T10:26:38,573 adding 'lm_eval/tasks/bigbench/generate_until/snarks.yaml' 2026-02-14T10:26:38,574 adding 'lm_eval/tasks/bigbench/generate_until/social_iqa.yaml' 2026-02-14T10:26:38,575 adding 'lm_eval/tasks/bigbench/generate_until/social_support.yaml' 2026-02-14T10:26:38,577 adding 'lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml' 2026-02-14T10:26:38,578 adding 'lm_eval/tasks/bigbench/generate_until/strange_stories.yaml' 2026-02-14T10:26:38,579 adding 'lm_eval/tasks/bigbench/generate_until/strategyqa.yaml' 2026-02-14T10:26:38,580 adding 'lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml' 2026-02-14T10:26:38,581 adding 'lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml' 2026-02-14T10:26:38,583 adding 'lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml' 2026-02-14T10:26:38,584 adding 'lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml' 2026-02-14T10:26:38,585 adding 'lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml' 2026-02-14T10:26:38,586 adding 'lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml' 2026-02-14T10:26:38,587 adding 'lm_eval/tasks/bigbench/generate_until/tense.yaml' 2026-02-14T10:26:38,589 adding 'lm_eval/tasks/bigbench/generate_until/timedial.yaml' 2026-02-14T10:26:38,590 adding 'lm_eval/tasks/bigbench/generate_until/topical_chat.yaml' 2026-02-14T10:26:38,591 adding 'lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml' 2026-02-14T10:26:38,592 adding 'lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml' 2026-02-14T10:26:38,593 adding 'lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml' 2026-02-14T10:26:38,595 adding 'lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml' 2026-02-14T10:26:38,596 adding 'lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml' 2026-02-14T10:26:38,597 adding 'lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml' 2026-02-14T10:26:38,598 adding 'lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml' 2026-02-14T10:26:38,599 adding 'lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml' 2026-02-14T10:26:38,600 adding 'lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml' 2026-02-14T10:26:38,601 adding 'lm_eval/tasks/bigbench/generate_until/winowhy.yaml' 2026-02-14T10:26:38,602 adding 'lm_eval/tasks/bigbench/generate_until/word_sorting.yaml' 2026-02-14T10:26:38,604 adding 'lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml' 2026-02-14T10:26:38,607 adding 'lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml' 2026-02-14T10:26:38,609 adding 'lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml' 2026-02-14T10:26:38,610 adding 'lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml' 2026-02-14T10:26:38,611 adding 'lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml' 2026-02-14T10:26:38,612 adding 'lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml' 2026-02-14T10:26:38,613 adding 'lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml' 2026-02-14T10:26:38,614 adding 'lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml' 2026-02-14T10:26:38,616 adding 'lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml' 2026-02-14T10:26:38,617 adding 'lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml' 2026-02-14T10:26:38,618 adding 'lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml' 2026-02-14T10:26:38,619 adding 'lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml' 2026-02-14T10:26:38,620 adding 'lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml' 2026-02-14T10:26:38,621 adding 'lm_eval/tasks/bigbench/multiple_choice/color.yaml' 2026-02-14T10:26:38,623 adding 'lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml' 2026-02-14T10:26:38,624 adding 'lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml' 2026-02-14T10:26:38,625 adding 'lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml' 2026-02-14T10:26:38,626 adding 'lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml' 2026-02-14T10:26:38,627 adding 'lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml' 2026-02-14T10:26:38,628 adding 'lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml' 2026-02-14T10:26:38,629 adding 'lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml' 2026-02-14T10:26:38,631 adding 'lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml' 2026-02-14T10:26:38,632 adding 'lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml' 2026-02-14T10:26:38,633 adding 'lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml' 2026-02-14T10:26:38,634 adding 'lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml' 2026-02-14T10:26:38,635 adding 'lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml' 2026-02-14T10:26:38,636 adding 'lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml' 2026-02-14T10:26:38,638 adding 'lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml' 2026-02-14T10:26:38,639 adding 'lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml' 2026-02-14T10:26:38,640 adding 'lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml' 2026-02-14T10:26:38,641 adding 'lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml' 2026-02-14T10:26:38,642 adding 'lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml' 2026-02-14T10:26:38,643 adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml' 2026-02-14T10:26:38,644 adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml' 2026-02-14T10:26:38,645 adding 'lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml' 2026-02-14T10:26:38,646 adding 'lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml' 2026-02-14T10:26:38,648 adding 'lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml' 2026-02-14T10:26:38,649 adding 'lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml' 2026-02-14T10:26:38,650 adding 'lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml' 2026-02-14T10:26:38,651 adding 'lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml' 2026-02-14T10:26:38,652 adding 'lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml' 2026-02-14T10:26:38,653 adding 'lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml' 2026-02-14T10:26:38,654 adding 'lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml' 2026-02-14T10:26:38,655 adding 'lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml' 2026-02-14T10:26:38,657 adding 'lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml' 2026-02-14T10:26:38,658 adding 'lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml' 2026-02-14T10:26:38,659 adding 'lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml' 2026-02-14T10:26:38,660 adding 'lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml' 2026-02-14T10:26:38,661 adding 'lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml' 2026-02-14T10:26:38,662 adding 'lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml' 2026-02-14T10:26:38,664 adding 'lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml' 2026-02-14T10:26:38,665 adding 'lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml' 2026-02-14T10:26:38,666 adding 'lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml' 2026-02-14T10:26:38,667 adding 'lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml' 2026-02-14T10:26:38,668 adding 'lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml' 2026-02-14T10:26:38,669 adding 'lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml' 2026-02-14T10:26:38,670 adding 'lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml' 2026-02-14T10:26:38,672 adding 'lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml' 2026-02-14T10:26:38,673 adding 'lm_eval/tasks/bigbench/multiple_choice/kannada.yaml' 2026-02-14T10:26:38,674 adding 'lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml' 2026-02-14T10:26:38,675 adding 'lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml' 2026-02-14T10:26:38,676 adding 'lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml' 2026-02-14T10:26:38,677 adding 'lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml' 2026-02-14T10:26:38,678 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml' 2026-02-14T10:26:38,680 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml' 2026-02-14T10:26:38,681 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml' 2026-02-14T10:26:38,682 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml' 2026-02-14T10:26:38,683 adding 'lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml' 2026-02-14T10:26:38,684 adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml' 2026-02-14T10:26:38,685 adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml' 2026-02-14T10:26:38,687 adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml' 2026-02-14T10:26:38,688 adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml' 2026-02-14T10:26:38,689 adding 'lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml' 2026-02-14T10:26:38,690 adding 'lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml' 2026-02-14T10:26:38,691 adding 'lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml' 2026-02-14T10:26:38,693 adding 'lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml' 2026-02-14T10:26:38,694 adding 'lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml' 2026-02-14T10:26:38,695 adding 'lm_eval/tasks/bigbench/multiple_choice/navigate.yaml' 2026-02-14T10:26:38,696 adding 'lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml' 2026-02-14T10:26:38,697 adding 'lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml' 2026-02-14T10:26:38,698 adding 'lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml' 2026-02-14T10:26:38,699 adding 'lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml' 2026-02-14T10:26:38,701 adding 'lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml' 2026-02-14T10:26:38,702 adding 'lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml' 2026-02-14T10:26:38,703 adding 'lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml' 2026-02-14T10:26:38,704 adding 'lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml' 2026-02-14T10:26:38,705 adding 'lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml' 2026-02-14T10:26:38,707 adding 'lm_eval/tasks/bigbench/multiple_choice/physics.yaml' 2026-02-14T10:26:38,708 adding 'lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml' 2026-02-14T10:26:38,709 adding 'lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml' 2026-02-14T10:26:38,710 adding 'lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml' 2026-02-14T10:26:38,711 adding 'lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml' 2026-02-14T10:26:38,712 adding 'lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml' 2026-02-14T10:26:38,714 adding 'lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml' 2026-02-14T10:26:38,715 adding 'lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml' 2026-02-14T10:26:38,716 adding 'lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml' 2026-02-14T10:26:38,717 adding 'lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml' 2026-02-14T10:26:38,718 adding 'lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml' 2026-02-14T10:26:38,719 adding 'lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml' 2026-02-14T10:26:38,720 adding 'lm_eval/tasks/bigbench/multiple_choice/snarks.yaml' 2026-02-14T10:26:38,722 adding 'lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml' 2026-02-14T10:26:38,723 adding 'lm_eval/tasks/bigbench/multiple_choice/social_support.yaml' 2026-02-14T10:26:38,724 adding 'lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml' 2026-02-14T10:26:38,725 adding 'lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml' 2026-02-14T10:26:38,726 adding 'lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml' 2026-02-14T10:26:38,728 adding 'lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml' 2026-02-14T10:26:38,729 adding 'lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml' 2026-02-14T10:26:38,730 adding 'lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml' 2026-02-14T10:26:38,731 adding 'lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml' 2026-02-14T10:26:38,732 adding 'lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml' 2026-02-14T10:26:38,733 adding 'lm_eval/tasks/bigbench/multiple_choice/timedial.yaml' 2026-02-14T10:26:38,735 adding 'lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml' 2026-02-14T10:26:38,736 adding 'lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml' 2026-02-14T10:26:38,737 adding 'lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml' 2026-02-14T10:26:38,738 adding 'lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml' 2026-02-14T10:26:38,739 adding 'lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml' 2026-02-14T10:26:38,741 adding 'lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml' 2026-02-14T10:26:38,742 adding 'lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml' 2026-02-14T10:26:38,743 adding 'lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml' 2026-02-14T10:26:38,744 adding 'lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml' 2026-02-14T10:26:38,747 adding 'lm_eval/tasks/blimp/README.md' 2026-02-14T10:26:38,748 adding 'lm_eval/tasks/blimp/_blimp.yaml' 2026-02-14T10:26:38,749 adding 'lm_eval/tasks/blimp/_template_yaml' 2026-02-14T10:26:38,750 adding 'lm_eval/tasks/blimp/adjunct_island.yaml' 2026-02-14T10:26:38,751 adding 'lm_eval/tasks/blimp/anaphor_gender_agreement.yaml' 2026-02-14T10:26:38,753 adding 'lm_eval/tasks/blimp/anaphor_number_agreement.yaml' 2026-02-14T10:26:38,754 adding 'lm_eval/tasks/blimp/animate_subject_passive.yaml' 2026-02-14T10:26:38,755 adding 'lm_eval/tasks/blimp/animate_subject_trans.yaml' 2026-02-14T10:26:38,756 adding 'lm_eval/tasks/blimp/causative.yaml' 2026-02-14T10:26:38,757 adding 'lm_eval/tasks/blimp/complex_NP_island.yaml' 2026-02-14T10:26:38,758 adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml' 2026-02-14T10:26:38,760 adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml' 2026-02-14T10:26:38,761 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml' 2026-02-14T10:26:38,762 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml' 2026-02-14T10:26:38,763 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml' 2026-02-14T10:26:38,764 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml' 2026-02-14T10:26:38,765 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml' 2026-02-14T10:26:38,767 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml' 2026-02-14T10:26:38,768 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml' 2026-02-14T10:26:38,769 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml' 2026-02-14T10:26:38,770 adding 'lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml' 2026-02-14T10:26:38,771 adding 'lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml' 2026-02-14T10:26:38,772 adding 'lm_eval/tasks/blimp/drop_argument.yaml' 2026-02-14T10:26:38,773 adding 'lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml' 2026-02-14T10:26:38,774 adding 'lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml' 2026-02-14T10:26:38,776 adding 'lm_eval/tasks/blimp/existential_there_object_raising.yaml' 2026-02-14T10:26:38,777 adding 'lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml' 2026-02-14T10:26:38,778 adding 'lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml' 2026-02-14T10:26:38,779 adding 'lm_eval/tasks/blimp/existential_there_subject_raising.yaml' 2026-02-14T10:26:38,780 adding 'lm_eval/tasks/blimp/expletive_it_object_raising.yaml' 2026-02-14T10:26:38,782 adding 'lm_eval/tasks/blimp/generate_configs.py' 2026-02-14T10:26:38,783 adding 'lm_eval/tasks/blimp/inchoative.yaml' 2026-02-14T10:26:38,784 adding 'lm_eval/tasks/blimp/intransitive.yaml' 2026-02-14T10:26:38,785 adding 'lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml' 2026-02-14T10:26:38,786 adding 'lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml' 2026-02-14T10:26:38,787 adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml' 2026-02-14T10:26:38,789 adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml' 2026-02-14T10:26:38,790 adding 'lm_eval/tasks/blimp/left_branch_island_echo_question.yaml' 2026-02-14T10:26:38,791 adding 'lm_eval/tasks/blimp/left_branch_island_simple_question.yaml' 2026-02-14T10:26:38,792 adding 'lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml' 2026-02-14T10:26:38,793 adding 'lm_eval/tasks/blimp/npi_present_1.yaml' 2026-02-14T10:26:38,795 adding 'lm_eval/tasks/blimp/npi_present_2.yaml' 2026-02-14T10:26:38,796 adding 'lm_eval/tasks/blimp/only_npi_licensor_present.yaml' 2026-02-14T10:26:38,797 adding 'lm_eval/tasks/blimp/only_npi_scope.yaml' 2026-02-14T10:26:38,798 adding 'lm_eval/tasks/blimp/passive_1.yaml' 2026-02-14T10:26:38,799 adding 'lm_eval/tasks/blimp/passive_2.yaml' 2026-02-14T10:26:38,800 adding 'lm_eval/tasks/blimp/principle_A_c_command.yaml' 2026-02-14T10:26:38,801 adding 'lm_eval/tasks/blimp/principle_A_case_1.yaml' 2026-02-14T10:26:38,802 adding 'lm_eval/tasks/blimp/principle_A_case_2.yaml' 2026-02-14T10:26:38,803 adding 'lm_eval/tasks/blimp/principle_A_domain_1.yaml' 2026-02-14T10:26:38,804 adding 'lm_eval/tasks/blimp/principle_A_domain_2.yaml' 2026-02-14T10:26:38,805 adding 'lm_eval/tasks/blimp/principle_A_domain_3.yaml' 2026-02-14T10:26:38,807 adding 'lm_eval/tasks/blimp/principle_A_reconstruction.yaml' 2026-02-14T10:26:38,808 adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml' 2026-02-14T10:26:38,809 adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml' 2026-02-14T10:26:38,810 adding 'lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml' 2026-02-14T10:26:38,811 adding 'lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml' 2026-02-14T10:26:38,812 adding 'lm_eval/tasks/blimp/sentential_subject_island.yaml' 2026-02-14T10:26:38,813 adding 'lm_eval/tasks/blimp/superlative_quantifiers_1.yaml' 2026-02-14T10:26:38,814 adding 'lm_eval/tasks/blimp/superlative_quantifiers_2.yaml' 2026-02-14T10:26:38,816 adding 'lm_eval/tasks/blimp/tough_vs_raising_1.yaml' 2026-02-14T10:26:38,817 adding 'lm_eval/tasks/blimp/tough_vs_raising_2.yaml' 2026-02-14T10:26:38,818 adding 'lm_eval/tasks/blimp/transitive.yaml' 2026-02-14T10:26:38,819 adding 'lm_eval/tasks/blimp/wh_island.yaml' 2026-02-14T10:26:38,820 adding 'lm_eval/tasks/blimp/wh_questions_object_gap.yaml' 2026-02-14T10:26:38,821 adding 'lm_eval/tasks/blimp/wh_questions_subject_gap.yaml' 2026-02-14T10:26:38,822 adding 'lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml' 2026-02-14T10:26:38,824 adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml' 2026-02-14T10:26:38,825 adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml' 2026-02-14T10:26:38,826 adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml' 2026-02-14T10:26:38,827 adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml' 2026-02-14T10:26:38,831 adding 'lm_eval/tasks/blimp_nl/README.md' 2026-02-14T10:26:38,832 adding 'lm_eval/tasks/blimp_nl/_template_yaml' 2026-02-14T10:26:38,833 adding 'lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml' 2026-02-14T10:26:38,834 adding 'lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml' 2026-02-14T10:26:38,836 adding 'lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml' 2026-02-14T10:26:38,837 adding 'lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml' 2026-02-14T10:26:38,838 adding 'lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml' 2026-02-14T10:26:38,839 adding 'lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml' 2026-02-14T10:26:38,840 adding 'lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml' 2026-02-14T10:26:38,841 adding 'lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml' 2026-02-14T10:26:38,842 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml' 2026-02-14T10:26:38,844 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml' 2026-02-14T10:26:38,845 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml' 2026-02-14T10:26:38,846 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml' 2026-02-14T10:26:38,847 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml' 2026-02-14T10:26:38,848 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml' 2026-02-14T10:26:38,850 adding 'lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml' 2026-02-14T10:26:38,851 adding 'lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml' 2026-02-14T10:26:38,852 adding 'lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml' 2026-02-14T10:26:38,853 adding 'lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml' 2026-02-14T10:26:38,854 adding 'lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml' 2026-02-14T10:26:38,855 adding 'lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml' 2026-02-14T10:26:38,856 adding 'lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml' 2026-02-14T10:26:38,857 adding 'lm_eval/tasks/blimp_nl/blimp_nl_group.yaml' 2026-02-14T10:26:38,858 adding 'lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml' 2026-02-14T10:26:38,860 adding 'lm_eval/tasks/blimp_nl/complementive__intransitive.yaml' 2026-02-14T10:26:38,861 adding 'lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml' 2026-02-14T10:26:38,862 adding 'lm_eval/tasks/blimp_nl/complementive__position_verb.yaml' 2026-02-14T10:26:38,863 adding 'lm_eval/tasks/blimp_nl/complementive__transitive.yaml' 2026-02-14T10:26:38,864 adding 'lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml' 2026-02-14T10:26:38,866 adding 'lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml' 2026-02-14T10:26:38,867 adding 'lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml' 2026-02-14T10:26:38,868 adding 'lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml' 2026-02-14T10:26:38,869 adding 'lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml' 2026-02-14T10:26:38,870 adding 'lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml' 2026-02-14T10:26:38,871 adding 'lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml' 2026-02-14T10:26:38,872 adding 'lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml' 2026-02-14T10:26:38,873 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml' 2026-02-14T10:26:38,874 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml' 2026-02-14T10:26:38,875 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml' 2026-02-14T10:26:38,877 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml' 2026-02-14T10:26:38,878 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml' 2026-02-14T10:26:38,879 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml' 2026-02-14T10:26:38,880 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml' 2026-02-14T10:26:38,881 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml' 2026-02-14T10:26:38,882 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml' 2026-02-14T10:26:38,883 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml' 2026-02-14T10:26:38,885 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml' 2026-02-14T10:26:38,886 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml' 2026-02-14T10:26:38,887 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml' 2026-02-14T10:26:38,888 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml' 2026-02-14T10:26:38,889 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml' 2026-02-14T10:26:38,890 adding 'lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml' 2026-02-14T10:26:38,891 adding 'lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml' 2026-02-14T10:26:38,893 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml' 2026-02-14T10:26:38,894 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml' 2026-02-14T10:26:38,895 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml' 2026-02-14T10:26:38,896 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml' 2026-02-14T10:26:38,897 adding 'lm_eval/tasks/blimp_nl/passive__aci.yaml' 2026-02-14T10:26:38,898 adding 'lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml' 2026-02-14T10:26:38,899 adding 'lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml' 2026-02-14T10:26:38,900 adding 'lm_eval/tasks/blimp_nl/passive__impersonal.yaml' 2026-02-14T10:26:38,901 adding 'lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml' 2026-02-14T10:26:38,902 adding 'lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml' 2026-02-14T10:26:38,903 adding 'lm_eval/tasks/blimp_nl/r_words__adverbial.yaml' 2026-02-14T10:26:38,904 adding 'lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml' 2026-02-14T10:26:38,905 adding 'lm_eval/tasks/blimp_nl/relativization__island.yaml' 2026-02-14T10:26:38,906 adding 'lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml' 2026-02-14T10:26:38,907 adding 'lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml' 2026-02-14T10:26:38,909 adding 'lm_eval/tasks/blimp_nl/topicalization__island.yaml' 2026-02-14T10:26:38,910 adding 'lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml' 2026-02-14T10:26:38,911 adding 'lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml' 2026-02-14T10:26:38,912 adding 'lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml' 2026-02-14T10:26:38,913 adding 'lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml' 2026-02-14T10:26:38,914 adding 'lm_eval/tasks/blimp_nl/verb_second__order_main.yaml' 2026-02-14T10:26:38,915 adding 'lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml' 2026-02-14T10:26:38,916 adding 'lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml' 2026-02-14T10:26:38,917 adding 'lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml' 2026-02-14T10:26:38,918 adding 'lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml' 2026-02-14T10:26:38,919 adding 'lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml' 2026-02-14T10:26:38,921 adding 'lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml' 2026-02-14T10:26:38,922 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml' 2026-02-14T10:26:38,923 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml' 2026-02-14T10:26:38,924 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml' 2026-02-14T10:26:38,925 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml' 2026-02-14T10:26:38,926 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml' 2026-02-14T10:26:38,927 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml' 2026-02-14T10:26:38,929 adding 'lm_eval/tasks/c4/README.md' 2026-02-14T10:26:38,931 adding 'lm_eval/tasks/c4/c4.yaml' 2026-02-14T10:26:38,932 adding 'lm_eval/tasks/c4/preprocess_c4.py' 2026-02-14T10:26:38,934 adding 'lm_eval/tasks/cabbq/README.md' 2026-02-14T10:26:38,935 adding 'lm_eval/tasks/cabbq/_cabbq_common_yaml' 2026-02-14T10:26:38,936 adding 'lm_eval/tasks/cabbq/cabbq.yaml' 2026-02-14T10:26:38,938 adding 'lm_eval/tasks/cabbq/cabbq_age.yaml' 2026-02-14T10:26:38,939 adding 'lm_eval/tasks/cabbq/cabbq_disability_status.yaml' 2026-02-14T10:26:38,940 adding 'lm_eval/tasks/cabbq/cabbq_gender.yaml' 2026-02-14T10:26:38,941 adding 'lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml' 2026-02-14T10:26:38,942 adding 'lm_eval/tasks/cabbq/cabbq_nationality.yaml' 2026-02-14T10:26:38,943 adding 'lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml' 2026-02-14T10:26:38,944 adding 'lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml' 2026-02-14T10:26:38,946 adding 'lm_eval/tasks/cabbq/cabbq_religion.yaml' 2026-02-14T10:26:38,947 adding 'lm_eval/tasks/cabbq/cabbq_ses.yaml' 2026-02-14T10:26:38,948 adding 'lm_eval/tasks/cabbq/cabbq_spanish_region.yaml' 2026-02-14T10:26:38,950 adding 'lm_eval/tasks/cabbq/utils.py' 2026-02-14T10:26:38,952 adding 'lm_eval/tasks/careqa/README.md' 2026-02-14T10:26:38,953 adding 'lm_eval/tasks/careqa/careqa_en.yaml' 2026-02-14T10:26:38,954 adding 'lm_eval/tasks/careqa/careqa_es.yaml' 2026-02-14T10:26:38,956 adding 'lm_eval/tasks/careqa/careqa_open.yaml' 2026-02-14T10:26:38,957 adding 'lm_eval/tasks/careqa/careqa_open_perplexity.yaml' 2026-02-14T10:26:38,958 adding 'lm_eval/tasks/careqa/utils.py' 2026-02-14T10:26:38,959 adding 'lm_eval/tasks/careqa/utils_open.py' 2026-02-14T10:26:38,960 adding 'lm_eval/tasks/careqa/utils_perplexity.py' 2026-02-14T10:26:38,963 adding 'lm_eval/tasks/catalan_bench/README.md' 2026-02-14T10:26:38,964 adding 'lm_eval/tasks/catalan_bench/_arc_ca_common_yaml' 2026-02-14T10:26:38,965 adding 'lm_eval/tasks/catalan_bench/_cabreu_common_yaml' 2026-02-14T10:26:38,966 adding 'lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml' 2026-02-14T10:26:38,967 adding 'lm_eval/tasks/catalan_bench/arc_ca_easy.yaml' 2026-02-14T10:26:38,968 adding 'lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml' 2026-02-14T10:26:38,969 adding 'lm_eval/tasks/catalan_bench/cabreu_extractive.yaml' 2026-02-14T10:26:38,970 adding 'lm_eval/tasks/catalan_bench/cabreu_extreme.yaml' 2026-02-14T10:26:38,972 adding 'lm_eval/tasks/catalan_bench/catalan_bench.yaml' 2026-02-14T10:26:38,973 adding 'lm_eval/tasks/catalan_bench/catalanqa.yaml' 2026-02-14T10:26:38,974 adding 'lm_eval/tasks/catalan_bench/catcola.yaml' 2026-02-14T10:26:38,975 adding 'lm_eval/tasks/catalan_bench/cocoteros_va.yaml' 2026-02-14T10:26:38,977 adding 'lm_eval/tasks/catalan_bench/copa_ca.yaml' 2026-02-14T10:26:38,978 adding 'lm_eval/tasks/catalan_bench/coqcat.yaml' 2026-02-14T10:26:38,979 adding 'lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml' 2026-02-14T10:26:38,980 adding 'lm_eval/tasks/catalan_bench/openbookqa_ca.yaml' 2026-02-14T10:26:38,981 adding 'lm_eval/tasks/catalan_bench/parafraseja.yaml' 2026-02-14T10:26:38,982 adding 'lm_eval/tasks/catalan_bench/paws_ca.yaml' 2026-02-14T10:26:38,983 adding 'lm_eval/tasks/catalan_bench/piqa_ca.yaml' 2026-02-14T10:26:38,985 adding 'lm_eval/tasks/catalan_bench/siqa_ca.yaml' 2026-02-14T10:26:38,986 adding 'lm_eval/tasks/catalan_bench/teca.yaml' 2026-02-14T10:26:38,987 adding 'lm_eval/tasks/catalan_bench/utils.py' 2026-02-14T10:26:38,988 adding 'lm_eval/tasks/catalan_bench/wnli_ca.yaml' 2026-02-14T10:26:38,990 adding 'lm_eval/tasks/catalan_bench/xnli_ca.yaml' 2026-02-14T10:26:38,991 adding 'lm_eval/tasks/catalan_bench/xnli_va.yaml' 2026-02-14T10:26:38,992 adding 'lm_eval/tasks/catalan_bench/xquad_ca.yaml' 2026-02-14T10:26:38,993 adding 'lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml' 2026-02-14T10:26:38,995 adding 'lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml' 2026-02-14T10:26:38,997 adding 'lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py' 2026-02-14T10:26:38,998 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml' 2026-02-14T10:26:38,999 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml' 2026-02-14T10:26:39,000 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml' 2026-02-14T10:26:39,002 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml' 2026-02-14T10:26:39,003 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml' 2026-02-14T10:26:39,004 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml' 2026-02-14T10:26:39,005 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml' 2026-02-14T10:26:39,006 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml' 2026-02-14T10:26:39,008 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml' 2026-02-14T10:26:39,009 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml' 2026-02-14T10:26:39,010 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml' 2026-02-14T10:26:39,011 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml' 2026-02-14T10:26:39,013 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml' 2026-02-14T10:26:39,014 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml' 2026-02-14T10:26:39,015 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml' 2026-02-14T10:26:39,016 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml' 2026-02-14T10:26:39,017 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml' 2026-02-14T10:26:39,019 adding 'lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common' 2026-02-14T10:26:39,020 adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml' 2026-02-14T10:26:39,021 adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml' 2026-02-14T10:26:39,023 adding 'lm_eval/tasks/catalan_bench/truthfulqa_va/truthfulqa_va.yaml' 2026-02-14T10:26:39,024 adding 'lm_eval/tasks/catalan_bench/truthfulqa_va/utils.py' 2026-02-14T10:26:39,028 adding 'lm_eval/tasks/ceval/README.md' 2026-02-14T10:26:39,029 adding 'lm_eval/tasks/ceval/_ceval-valid.yaml' 2026-02-14T10:26:39,030 adding 'lm_eval/tasks/ceval/_default_ceval_yaml' 2026-02-14T10:26:39,031 adding 'lm_eval/tasks/ceval/_generate_configs.py' 2026-02-14T10:26:39,032 adding 'lm_eval/tasks/ceval/ceval-valid_accountant.yaml' 2026-02-14T10:26:39,034 adding 'lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml' 2026-02-14T10:26:39,035 adding 'lm_eval/tasks/ceval/ceval-valid_art_studies.yaml' 2026-02-14T10:26:39,036 adding 'lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml' 2026-02-14T10:26:39,037 adding 'lm_eval/tasks/ceval/ceval-valid_business_administration.yaml' 2026-02-14T10:26:39,038 adding 'lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml' 2026-02-14T10:26:39,039 adding 'lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml' 2026-02-14T10:26:39,041 adding 'lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml' 2026-02-14T10:26:39,042 adding 'lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml' 2026-02-14T10:26:39,043 adding 'lm_eval/tasks/ceval/ceval-valid_college_economics.yaml' 2026-02-14T10:26:39,044 adding 'lm_eval/tasks/ceval/ceval-valid_college_physics.yaml' 2026-02-14T10:26:39,045 adding 'lm_eval/tasks/ceval/ceval-valid_college_programming.yaml' 2026-02-14T10:26:39,046 adding 'lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml' 2026-02-14T10:26:39,048 adding 'lm_eval/tasks/ceval/ceval-valid_computer_network.yaml' 2026-02-14T10:26:39,049 adding 'lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml' 2026-02-14T10:26:39,050 adding 'lm_eval/tasks/ceval/ceval-valid_education_science.yaml' 2026-02-14T10:26:39,051 adding 'lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml' 2026-02-14T10:26:39,052 adding 'lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml' 2026-02-14T10:26:39,053 adding 'lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml' 2026-02-14T10:26:39,055 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml' 2026-02-14T10:26:39,056 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml' 2026-02-14T10:26:39,057 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml' 2026-02-14T10:26:39,058 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml' 2026-02-14T10:26:39,059 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml' 2026-02-14T10:26:39,060 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml' 2026-02-14T10:26:39,062 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml' 2026-02-14T10:26:39,063 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml' 2026-02-14T10:26:39,064 adding 'lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml' 2026-02-14T10:26:39,065 adding 'lm_eval/tasks/ceval/ceval-valid_law.yaml' 2026-02-14T10:26:39,066 adding 'lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml' 2026-02-14T10:26:39,068 adding 'lm_eval/tasks/ceval/ceval-valid_logic.yaml' 2026-02-14T10:26:39,069 adding 'lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml' 2026-02-14T10:26:39,070 adding 'lm_eval/tasks/ceval/ceval-valid_marxism.yaml' 2026-02-14T10:26:39,071 adding 'lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml' 2026-02-14T10:26:39,072 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml' 2026-02-14T10:26:39,074 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml' 2026-02-14T10:26:39,075 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml' 2026-02-14T10:26:39,076 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml' 2026-02-14T10:26:39,077 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml' 2026-02-14T10:26:39,078 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml' 2026-02-14T10:26:39,079 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml' 2026-02-14T10:26:39,080 adding 'lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml' 2026-02-14T10:26:39,081 adding 'lm_eval/tasks/ceval/ceval-valid_operating_system.yaml' 2026-02-14T10:26:39,082 adding 'lm_eval/tasks/ceval/ceval-valid_physician.yaml' 2026-02-14T10:26:39,083 adding 'lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml' 2026-02-14T10:26:39,085 adding 'lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml' 2026-02-14T10:26:39,086 adding 'lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml' 2026-02-14T10:26:39,087 adding 'lm_eval/tasks/ceval/ceval-valid_sports_science.yaml' 2026-02-14T10:26:39,088 adding 'lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml' 2026-02-14T10:26:39,089 adding 'lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml' 2026-02-14T10:26:39,091 adding 'lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml' 2026-02-14T10:26:39,092 adding 'lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml' 2026-02-14T10:26:39,093 adding 'lm_eval/tasks/chartqa/README.md' 2026-02-14T10:26:39,095 adding 'lm_eval/tasks/chartqa/chartqa.yaml' 2026-02-14T10:26:39,096 adding 'lm_eval/tasks/chartqa/chartqa_llama.yaml' 2026-02-14T10:26:39,097 adding 'lm_eval/tasks/chartqa/chartqa_llama_90.yaml' 2026-02-14T10:26:39,099 adding 'lm_eval/tasks/chartqa/utils.py' 2026-02-14T10:26:39,101 adding 'lm_eval/tasks/click/README.md' 2026-02-14T10:26:39,102 adding 'lm_eval/tasks/click/click.yaml' 2026-02-14T10:26:39,104 adding 'lm_eval/tasks/click/click_cul/_click_cul.yaml' 2026-02-14T10:26:39,105 adding 'lm_eval/tasks/click/click_cul/_default_click_cul_yaml' 2026-02-14T10:26:39,106 adding 'lm_eval/tasks/click/click_cul/click_cul_economy.yaml' 2026-02-14T10:26:39,107 adding 'lm_eval/tasks/click/click_cul/click_cul_geography.yaml' 2026-02-14T10:26:39,109 adding 'lm_eval/tasks/click/click_cul/click_cul_history.yaml' 2026-02-14T10:26:39,110 adding 'lm_eval/tasks/click/click_cul/click_cul_kpop.yaml' 2026-02-14T10:26:39,111 adding 'lm_eval/tasks/click/click_cul/click_cul_law.yaml' 2026-02-14T10:26:39,112 adding 'lm_eval/tasks/click/click_cul/click_cul_politics.yaml' 2026-02-14T10:26:39,113 adding 'lm_eval/tasks/click/click_cul/click_cul_society.yaml' 2026-02-14T10:26:39,114 adding 'lm_eval/tasks/click/click_cul/click_cul_tradition.yaml' 2026-02-14T10:26:39,116 adding 'lm_eval/tasks/click/click_cul/utils.py' 2026-02-14T10:26:39,117 adding 'lm_eval/tasks/click/click_lang/_click_lang.yaml' 2026-02-14T10:26:39,119 adding 'lm_eval/tasks/click/click_lang/_default_click_lang_yaml' 2026-02-14T10:26:39,120 adding 'lm_eval/tasks/click/click_lang/click_lang_function.yaml' 2026-02-14T10:26:39,121 adding 'lm_eval/tasks/click/click_lang/click_lang_grammar.yaml' 2026-02-14T10:26:39,122 adding 'lm_eval/tasks/click/click_lang/click_lang_text.yaml' 2026-02-14T10:26:39,123 adding 'lm_eval/tasks/click/click_lang/utils.py' 2026-02-14T10:26:39,127 adding 'lm_eval/tasks/cmmlu/README.md' 2026-02-14T10:26:39,128 adding 'lm_eval/tasks/cmmlu/_cmmlu.yaml' 2026-02-14T10:26:39,129 adding 'lm_eval/tasks/cmmlu/_default_template_yaml' 2026-02-14T10:26:39,131 adding 'lm_eval/tasks/cmmlu/_generate_configs.py' 2026-02-14T10:26:39,132 adding 'lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml' 2026-02-14T10:26:39,133 adding 'lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml' 2026-02-14T10:26:39,134 adding 'lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml' 2026-02-14T10:26:39,136 adding 'lm_eval/tasks/cmmlu/cmmlu_arts.yaml' 2026-02-14T10:26:39,137 adding 'lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml' 2026-02-14T10:26:39,138 adding 'lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml' 2026-02-14T10:26:39,139 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml' 2026-02-14T10:26:39,140 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml' 2026-02-14T10:26:39,141 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml' 2026-02-14T10:26:39,142 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml' 2026-02-14T10:26:39,143 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml' 2026-02-14T10:26:39,145 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml' 2026-02-14T10:26:39,146 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml' 2026-02-14T10:26:39,147 adding 'lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml' 2026-02-14T10:26:39,148 adding 'lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml' 2026-02-14T10:26:39,149 adding 'lm_eval/tasks/cmmlu/cmmlu_college_education.yaml' 2026-02-14T10:26:39,150 adding 'lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml' 2026-02-14T10:26:39,151 adding 'lm_eval/tasks/cmmlu/cmmlu_college_law.yaml' 2026-02-14T10:26:39,153 adding 'lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml' 2026-02-14T10:26:39,154 adding 'lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml' 2026-02-14T10:26:39,155 adding 'lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml' 2026-02-14T10:26:39,156 adding 'lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml' 2026-02-14T10:26:39,157 adding 'lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml' 2026-02-14T10:26:39,158 adding 'lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml' 2026-02-14T10:26:39,160 adding 'lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml' 2026-02-14T10:26:39,161 adding 'lm_eval/tasks/cmmlu/cmmlu_economics.yaml' 2026-02-14T10:26:39,162 adding 'lm_eval/tasks/cmmlu/cmmlu_education.yaml' 2026-02-14T10:26:39,163 adding 'lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml' 2026-02-14T10:26:39,164 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml' 2026-02-14T10:26:39,165 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml' 2026-02-14T10:26:39,167 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml' 2026-02-14T10:26:39,168 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml' 2026-02-14T10:26:39,169 adding 'lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml' 2026-02-14T10:26:39,170 adding 'lm_eval/tasks/cmmlu/cmmlu_food_science.yaml' 2026-02-14T10:26:39,171 adding 'lm_eval/tasks/cmmlu/cmmlu_genetics.yaml' 2026-02-14T10:26:39,172 adding 'lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml' 2026-02-14T10:26:39,174 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml' 2026-02-14T10:26:39,175 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml' 2026-02-14T10:26:39,176 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml' 2026-02-14T10:26:39,177 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml' 2026-02-14T10:26:39,178 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml' 2026-02-14T10:26:39,180 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml' 2026-02-14T10:26:39,181 adding 'lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml' 2026-02-14T10:26:39,182 adding 'lm_eval/tasks/cmmlu/cmmlu_international_law.yaml' 2026-02-14T10:26:39,183 adding 'lm_eval/tasks/cmmlu/cmmlu_journalism.yaml' 2026-02-14T10:26:39,184 adding 'lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml' 2026-02-14T10:26:39,186 adding 'lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml' 2026-02-14T10:26:39,187 adding 'lm_eval/tasks/cmmlu/cmmlu_logical.yaml' 2026-02-14T10:26:39,188 adding 'lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml' 2026-02-14T10:26:39,189 adding 'lm_eval/tasks/cmmlu/cmmlu_management.yaml' 2026-02-14T10:26:39,191 adding 'lm_eval/tasks/cmmlu/cmmlu_marketing.yaml' 2026-02-14T10:26:39,192 adding 'lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml' 2026-02-14T10:26:39,193 adding 'lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml' 2026-02-14T10:26:39,194 adding 'lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml' 2026-02-14T10:26:39,195 adding 'lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml' 2026-02-14T10:26:39,196 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml' 2026-02-14T10:26:39,198 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml' 2026-02-14T10:26:39,199 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml' 2026-02-14T10:26:39,200 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml' 2026-02-14T10:26:39,201 adding 'lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml' 2026-02-14T10:26:39,202 adding 'lm_eval/tasks/cmmlu/cmmlu_security_study.yaml' 2026-02-14T10:26:39,203 adding 'lm_eval/tasks/cmmlu/cmmlu_sociology.yaml' 2026-02-14T10:26:39,204 adding 'lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml' 2026-02-14T10:26:39,205 adding 'lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml' 2026-02-14T10:26:39,206 adding 'lm_eval/tasks/cmmlu/cmmlu_virology.yaml' 2026-02-14T10:26:39,208 adding 'lm_eval/tasks/cmmlu/cmmlu_world_history.yaml' 2026-02-14T10:26:39,209 adding 'lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml' 2026-02-14T10:26:39,211 adding 'lm_eval/tasks/cnn_dailymail/README.md' 2026-02-14T10:26:39,212 adding 'lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml' 2026-02-14T10:26:39,214 adding 'lm_eval/tasks/cnn_dailymail/utils.py' 2026-02-14T10:26:39,216 adding 'lm_eval/tasks/code_x_glue/code-text/README.md' 2026-02-14T10:26:39,217 adding 'lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml' 2026-02-14T10:26:39,218 adding 'lm_eval/tasks/code_x_glue/code-text/_default_template_yaml' 2026-02-14T10:26:39,220 adding 'lm_eval/tasks/code_x_glue/code-text/bleu.py' 2026-02-14T10:26:39,221 adding 'lm_eval/tasks/code_x_glue/code-text/go.yaml' 2026-02-14T10:26:39,222 adding 'lm_eval/tasks/code_x_glue/code-text/java.yaml' 2026-02-14T10:26:39,223 adding 'lm_eval/tasks/code_x_glue/code-text/javascript.yaml' 2026-02-14T10:26:39,224 adding 'lm_eval/tasks/code_x_glue/code-text/php.yaml' 2026-02-14T10:26:39,226 adding 'lm_eval/tasks/code_x_glue/code-text/python.yaml' 2026-02-14T10:26:39,227 adding 'lm_eval/tasks/code_x_glue/code-text/ruby.yaml' 2026-02-14T10:26:39,228 adding 'lm_eval/tasks/code_x_glue/code-text/utils.py' 2026-02-14T10:26:39,230 adding 'lm_eval/tasks/common_voice/common_voice_en.yaml' 2026-02-14T10:26:39,231 adding 'lm_eval/tasks/common_voice/utils.py' 2026-02-14T10:26:39,233 adding 'lm_eval/tasks/commonsense_qa/README.md' 2026-02-14T10:26:39,234 adding 'lm_eval/tasks/commonsense_qa/default.yaml' 2026-02-14T10:26:39,236 adding 'lm_eval/tasks/copal_id/README.md' 2026-02-14T10:26:39,237 adding 'lm_eval/tasks/copal_id/colloquial.yaml' 2026-02-14T10:26:39,238 adding 'lm_eval/tasks/copal_id/standard.yaml' 2026-02-14T10:26:39,239 adding 'lm_eval/tasks/copal_id/utils.py' 2026-02-14T10:26:39,241 adding 'lm_eval/tasks/coqa/README.md' 2026-02-14T10:26:39,242 adding 'lm_eval/tasks/coqa/default.yaml' 2026-02-14T10:26:39,244 adding 'lm_eval/tasks/coqa/utils.py' 2026-02-14T10:26:39,246 adding 'lm_eval/tasks/crows_pairs/README.md' 2026-02-14T10:26:39,248 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english.yaml' 2026-02-14T10:26:39,249 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml' 2026-02-14T10:26:39,250 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml' 2026-02-14T10:26:39,251 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml' 2026-02-14T10:26:39,252 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml' 2026-02-14T10:26:39,253 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml' 2026-02-14T10:26:39,255 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml' 2026-02-14T10:26:39,256 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml' 2026-02-14T10:26:39,257 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml' 2026-02-14T10:26:39,258 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml' 2026-02-14T10:26:39,259 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml' 2026-02-14T10:26:39,260 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french.yaml' 2026-02-14T10:26:39,262 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml' 2026-02-14T10:26:39,263 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml' 2026-02-14T10:26:39,264 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml' 2026-02-14T10:26:39,265 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml' 2026-02-14T10:26:39,266 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml' 2026-02-14T10:26:39,267 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml' 2026-02-14T10:26:39,268 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml' 2026-02-14T10:26:39,269 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml' 2026-02-14T10:26:39,270 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml' 2026-02-14T10:26:39,271 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml' 2026-02-14T10:26:39,273 adding 'lm_eval/tasks/crows_pairs/utils.py' 2026-02-14T10:26:39,274 adding 'lm_eval/tasks/csatqa/_csatqa.yaml' 2026-02-14T10:26:39,276 adding 'lm_eval/tasks/csatqa/_default_csatqa_yaml' 2026-02-14T10:26:39,277 adding 'lm_eval/tasks/csatqa/_generate_configs.py' 2026-02-14T10:26:39,278 adding 'lm_eval/tasks/csatqa/csatqa_gr.yaml' 2026-02-14T10:26:39,279 adding 'lm_eval/tasks/csatqa/csatqa_li.yaml' 2026-02-14T10:26:39,280 adding 'lm_eval/tasks/csatqa/csatqa_rch.yaml' 2026-02-14T10:26:39,281 adding 'lm_eval/tasks/csatqa/csatqa_rcs.yaml' 2026-02-14T10:26:39,282 adding 'lm_eval/tasks/csatqa/csatqa_rcss.yaml' 2026-02-14T10:26:39,283 adding 'lm_eval/tasks/csatqa/csatqa_wr.yaml' 2026-02-14T10:26:39,285 adding 'lm_eval/tasks/csatqa/utils.py' 2026-02-14T10:26:39,286 adding 'lm_eval/tasks/darija_bench/README.md' 2026-02-14T10:26:39,289 adding 'lm_eval/tasks/darija_bench/darija_sentiment/README.md' 2026-02-14T10:26:39,290 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml' 2026-02-14T10:26:39,291 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml' 2026-02-14T10:26:39,292 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml' 2026-02-14T10:26:39,293 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml' 2026-02-14T10:26:39,294 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml' 2026-02-14T10:26:39,296 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml' 2026-02-14T10:26:39,297 adding 'lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml' 2026-02-14T10:26:39,298 adding 'lm_eval/tasks/darija_bench/darija_sentiment/utils.py' 2026-02-14T10:26:39,300 adding 'lm_eval/tasks/darija_bench/darija_summarization/README.md' 2026-02-14T10:26:39,301 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml' 2026-02-14T10:26:39,302 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml' 2026-02-14T10:26:39,304 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml' 2026-02-14T10:26:39,305 adding 'lm_eval/tasks/darija_bench/darija_summarization/utils.py' 2026-02-14T10:26:39,308 adding 'lm_eval/tasks/darija_bench/darija_translation/README.md' 2026-02-14T10:26:39,309 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml' 2026-02-14T10:26:39,310 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml' 2026-02-14T10:26:39,311 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml' 2026-02-14T10:26:39,312 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml' 2026-02-14T10:26:39,314 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml' 2026-02-14T10:26:39,315 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml' 2026-02-14T10:26:39,316 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml' 2026-02-14T10:26:39,317 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml' 2026-02-14T10:26:39,318 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml' 2026-02-14T10:26:39,319 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml' 2026-02-14T10:26:39,320 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml' 2026-02-14T10:26:39,321 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml' 2026-02-14T10:26:39,322 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml' 2026-02-14T10:26:39,323 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml' 2026-02-14T10:26:39,325 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml' 2026-02-14T10:26:39,326 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml' 2026-02-14T10:26:39,327 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml' 2026-02-14T10:26:39,328 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml' 2026-02-14T10:26:39,329 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml' 2026-02-14T10:26:39,330 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml' 2026-02-14T10:26:39,331 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml' 2026-02-14T10:26:39,332 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml' 2026-02-14T10:26:39,334 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml' 2026-02-14T10:26:39,335 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml' 2026-02-14T10:26:39,336 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml' 2026-02-14T10:26:39,337 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml' 2026-02-14T10:26:39,338 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml' 2026-02-14T10:26:39,339 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml' 2026-02-14T10:26:39,341 adding 'lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml' 2026-02-14T10:26:39,342 adding 'lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml' 2026-02-14T10:26:39,343 adding 'lm_eval/tasks/darija_bench/darija_translation/utils.py' 2026-02-14T10:26:39,345 adding 'lm_eval/tasks/darija_bench/darija_transliteration/README.md' 2026-02-14T10:26:39,346 adding 'lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml' 2026-02-14T10:26:39,347 adding 'lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml' 2026-02-14T10:26:39,349 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml' 2026-02-14T10:26:39,350 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml' 2026-02-14T10:26:39,351 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml' 2026-02-14T10:26:39,352 adding 'lm_eval/tasks/darija_bench/darija_transliteration/utils.py' 2026-02-14T10:26:39,354 adding 'lm_eval/tasks/darijahellaswag/README.md' 2026-02-14T10:26:39,355 adding 'lm_eval/tasks/darijahellaswag/darijahellaswag.yaml' 2026-02-14T10:26:39,356 adding 'lm_eval/tasks/darijahellaswag/utils.py' 2026-02-14T10:26:39,359 adding 'lm_eval/tasks/darijammlu/README.md' 2026-02-14T10:26:39,361 adding 'lm_eval/tasks/darijammlu/_darijammlu.yaml' 2026-02-14T10:26:39,362 adding 'lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml' 2026-02-14T10:26:39,363 adding 'lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml' 2026-02-14T10:26:39,364 adding 'lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml' 2026-02-14T10:26:39,366 adding 'lm_eval/tasks/darijammlu/_generate_configs.py' 2026-02-14T10:26:39,367 adding 'lm_eval/tasks/darijammlu/darijammlu_accounting.yaml' 2026-02-14T10:26:39,368 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml' 2026-02-14T10:26:39,369 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml' 2026-02-14T10:26:39,370 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml' 2026-02-14T10:26:39,371 adding 'lm_eval/tasks/darijammlu/darijammlu_biology.yaml' 2026-02-14T10:26:39,372 adding 'lm_eval/tasks/darijammlu/darijammlu_civics.yaml' 2026-02-14T10:26:39,373 adding 'lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml' 2026-02-14T10:26:39,374 adding 'lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml' 2026-02-14T10:26:39,375 adding 'lm_eval/tasks/darijammlu/darijammlu_economics.yaml' 2026-02-14T10:26:39,376 adding 'lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml' 2026-02-14T10:26:39,377 adding 'lm_eval/tasks/darijammlu/darijammlu_geography.yaml' 2026-02-14T10:26:39,378 adding 'lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml' 2026-02-14T10:26:39,379 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml' 2026-02-14T10:26:39,381 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml' 2026-02-14T10:26:39,382 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:39,383 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml' 2026-02-14T10:26:39,384 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml' 2026-02-14T10:26:39,385 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml' 2026-02-14T10:26:39,386 adding 'lm_eval/tasks/darijammlu/darijammlu_history.yaml' 2026-02-14T10:26:39,387 adding 'lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml' 2026-02-14T10:26:39,388 adding 'lm_eval/tasks/darijammlu/darijammlu_international_law.yaml' 2026-02-14T10:26:39,390 adding 'lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml' 2026-02-14T10:26:39,391 adding 'lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml' 2026-02-14T10:26:39,392 adding 'lm_eval/tasks/darijammlu/darijammlu_law.yaml' 2026-02-14T10:26:39,393 adding 'lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml' 2026-02-14T10:26:39,394 adding 'lm_eval/tasks/darijammlu/darijammlu_management.yaml' 2026-02-14T10:26:39,395 adding 'lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml' 2026-02-14T10:26:39,397 adding 'lm_eval/tasks/darijammlu/darijammlu_marketing.yaml' 2026-02-14T10:26:39,398 adding 'lm_eval/tasks/darijammlu/darijammlu_math.yaml' 2026-02-14T10:26:39,399 adding 'lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml' 2026-02-14T10:26:39,400 adding 'lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml' 2026-02-14T10:26:39,401 adding 'lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml' 2026-02-14T10:26:39,402 adding 'lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml' 2026-02-14T10:26:39,403 adding 'lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml' 2026-02-14T10:26:39,405 adding 'lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml' 2026-02-14T10:26:39,406 adding 'lm_eval/tasks/darijammlu/darijammlu_physics.yaml' 2026-02-14T10:26:39,407 adding 'lm_eval/tasks/darijammlu/darijammlu_political_science.yaml' 2026-02-14T10:26:39,408 adding 'lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml' 2026-02-14T10:26:39,409 adding 'lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml' 2026-02-14T10:26:39,410 adding 'lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml' 2026-02-14T10:26:39,412 adding 'lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml' 2026-02-14T10:26:39,413 adding 'lm_eval/tasks/darijammlu/darijammlu_social_science.yaml' 2026-02-14T10:26:39,414 adding 'lm_eval/tasks/darijammlu/darijammlu_sociology.yaml' 2026-02-14T10:26:39,415 adding 'lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml' 2026-02-14T10:26:39,416 adding 'lm_eval/tasks/darijammlu/utils.py' 2026-02-14T10:26:39,418 adding 'lm_eval/tasks/discrim_eval/README.md' 2026-02-14T10:26:39,419 adding 'lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml' 2026-02-14T10:26:39,420 adding 'lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml' 2026-02-14T10:26:39,422 adding 'lm_eval/tasks/discrim_eval/utils.py' 2026-02-14T10:26:39,424 adding 'lm_eval/tasks/drop/README.md' 2026-02-14T10:26:39,425 adding 'lm_eval/tasks/drop/default.yaml' 2026-02-14T10:26:39,427 adding 'lm_eval/tasks/drop/utils.py' 2026-02-14T10:26:39,429 adding 'lm_eval/tasks/e2lmc/mmlu_early_training/README.md' 2026-02-14T10:26:39,430 adding 'lm_eval/tasks/e2lmc/mmlu_early_training/custom_metrics.py' 2026-02-14T10:26:39,431 adding 'lm_eval/tasks/e2lmc/mmlu_early_training/mmlu_early_training.yaml' 2026-02-14T10:26:39,433 adding 'lm_eval/tasks/e2lmc/noor/README.md' 2026-02-14T10:26:39,435 adding 'lm_eval/tasks/e2lmc/noor/_generate_configs.py' 2026-02-14T10:26:39,436 adding 'lm_eval/tasks/e2lmc/noor/_noor.yaml' 2026-02-14T10:26:39,437 adding 'lm_eval/tasks/e2lmc/noor/_noor_stem.yaml' 2026-02-14T10:26:39,438 adding 'lm_eval/tasks/e2lmc/noor/_noor_template' 2026-02-14T10:26:39,439 adding 'lm_eval/tasks/e2lmc/noor/noor_abstract_algebra.yaml' 2026-02-14T10:26:39,441 adding 'lm_eval/tasks/e2lmc/noor/noor_college_computer_science.yaml' 2026-02-14T10:26:39,442 adding 'lm_eval/tasks/e2lmc/noor/noor_college_mathematics.yaml' 2026-02-14T10:26:39,443 adding 'lm_eval/tasks/e2lmc/noor/noor_college_physics.yaml' 2026-02-14T10:26:39,444 adding 'lm_eval/tasks/e2lmc/noor/noor_conceptual_physics.yaml' 2026-02-14T10:26:39,445 adding 'lm_eval/tasks/e2lmc/noor/noor_electrical_engineering.yaml' 2026-02-14T10:26:39,446 adding 'lm_eval/tasks/e2lmc/noor/noor_elementary_mathematics.yaml' 2026-02-14T10:26:39,448 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_computer_science.yaml' 2026-02-14T10:26:39,449 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_mathematics.yaml' 2026-02-14T10:26:39,450 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_physics.yaml' 2026-02-14T10:26:39,451 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_statistics.yaml' 2026-02-14T10:26:39,452 adding 'lm_eval/tasks/e2lmc/noor/noor_machine_learning.yaml' 2026-02-14T10:26:39,454 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/README.md' 2026-02-14T10:26:39,456 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/_sciknoweval_mcqa.yaml' 2026-02-14T10:26:39,457 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/_var5shots_template_yaml' 2026-02-14T10:26:39,458 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Biology.yaml' 2026-02-14T10:26:39,459 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Chemistry.yaml' 2026-02-14T10:26:39,460 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Material.yaml' 2026-02-14T10:26:39,462 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Physics.yaml' 2026-02-14T10:26:39,464 adding 'lm_eval/tasks/egyhellaswag/README.md' 2026-02-14T10:26:39,465 adding 'lm_eval/tasks/egyhellaswag/egyhellaswag.yaml' 2026-02-14T10:26:39,466 adding 'lm_eval/tasks/egyhellaswag/utils.py' 2026-02-14T10:26:39,469 adding 'lm_eval/tasks/egymmlu/README.md' 2026-02-14T10:26:39,470 adding 'lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml' 2026-02-14T10:26:39,471 adding 'lm_eval/tasks/egymmlu/_egymmlu.yaml' 2026-02-14T10:26:39,473 adding 'lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml' 2026-02-14T10:26:39,474 adding 'lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml' 2026-02-14T10:26:39,475 adding 'lm_eval/tasks/egymmlu/_generate_configs.py' 2026-02-14T10:26:39,476 adding 'lm_eval/tasks/egymmlu/egymmlu_accounting.yaml' 2026-02-14T10:26:39,478 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml' 2026-02-14T10:26:39,479 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml' 2026-02-14T10:26:39,480 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml' 2026-02-14T10:26:39,481 adding 'lm_eval/tasks/egymmlu/egymmlu_biology.yaml' 2026-02-14T10:26:39,482 adding 'lm_eval/tasks/egymmlu/egymmlu_civics.yaml' 2026-02-14T10:26:39,483 adding 'lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml' 2026-02-14T10:26:39,484 adding 'lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml' 2026-02-14T10:26:39,485 adding 'lm_eval/tasks/egymmlu/egymmlu_economics.yaml' 2026-02-14T10:26:39,486 adding 'lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml' 2026-02-14T10:26:39,487 adding 'lm_eval/tasks/egymmlu/egymmlu_geography.yaml' 2026-02-14T10:26:39,489 adding 'lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml' 2026-02-14T10:26:39,490 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml' 2026-02-14T10:26:39,491 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml' 2026-02-14T10:26:39,492 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:39,493 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml' 2026-02-14T10:26:39,494 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml' 2026-02-14T10:26:39,495 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml' 2026-02-14T10:26:39,497 adding 'lm_eval/tasks/egymmlu/egymmlu_history.yaml' 2026-02-14T10:26:39,498 adding 'lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml' 2026-02-14T10:26:39,499 adding 'lm_eval/tasks/egymmlu/egymmlu_international_law.yaml' 2026-02-14T10:26:39,500 adding 'lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml' 2026-02-14T10:26:39,501 adding 'lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml' 2026-02-14T10:26:39,502 adding 'lm_eval/tasks/egymmlu/egymmlu_law.yaml' 2026-02-14T10:26:39,503 adding 'lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml' 2026-02-14T10:26:39,505 adding 'lm_eval/tasks/egymmlu/egymmlu_management.yaml' 2026-02-14T10:26:39,506 adding 'lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml' 2026-02-14T10:26:39,507 adding 'lm_eval/tasks/egymmlu/egymmlu_marketing.yaml' 2026-02-14T10:26:39,508 adding 'lm_eval/tasks/egymmlu/egymmlu_math.yaml' 2026-02-14T10:26:39,509 adding 'lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml' 2026-02-14T10:26:39,510 adding 'lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml' 2026-02-14T10:26:39,511 adding 'lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml' 2026-02-14T10:26:39,513 adding 'lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml' 2026-02-14T10:26:39,514 adding 'lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml' 2026-02-14T10:26:39,515 adding 'lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml' 2026-02-14T10:26:39,516 adding 'lm_eval/tasks/egymmlu/egymmlu_physics.yaml' 2026-02-14T10:26:39,517 adding 'lm_eval/tasks/egymmlu/egymmlu_political_science.yaml' 2026-02-14T10:26:39,518 adding 'lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml' 2026-02-14T10:26:39,520 adding 'lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml' 2026-02-14T10:26:39,521 adding 'lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml' 2026-02-14T10:26:39,522 adding 'lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml' 2026-02-14T10:26:39,523 adding 'lm_eval/tasks/egymmlu/egymmlu_social_science.yaml' 2026-02-14T10:26:39,524 adding 'lm_eval/tasks/egymmlu/egymmlu_sociology.yaml' 2026-02-14T10:26:39,526 adding 'lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml' 2026-02-14T10:26:39,527 adding 'lm_eval/tasks/egymmlu/utils.py' 2026-02-14T10:26:39,529 adding 'lm_eval/tasks/eq_bench/README.md' 2026-02-14T10:26:39,530 adding 'lm_eval/tasks/eq_bench/default.yaml' 2026-02-14T10:26:39,531 adding 'lm_eval/tasks/eq_bench/utils.py' 2026-02-14T10:26:39,533 adding 'lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml' 2026-02-14T10:26:39,534 adding 'lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml' 2026-02-14T10:26:39,536 adding 'lm_eval/tasks/eq_bench/multilingual/utils.py' 2026-02-14T10:26:39,538 adding 'lm_eval/tasks/esbbq/README.md' 2026-02-14T10:26:39,539 adding 'lm_eval/tasks/esbbq/_esbbq_common_yaml' 2026-02-14T10:26:39,540 adding 'lm_eval/tasks/esbbq/esbbq.yaml' 2026-02-14T10:26:39,541 adding 'lm_eval/tasks/esbbq/esbbq_age.yaml' 2026-02-14T10:26:39,542 adding 'lm_eval/tasks/esbbq/esbbq_disability_status.yaml' 2026-02-14T10:26:39,543 adding 'lm_eval/tasks/esbbq/esbbq_gender.yaml' 2026-02-14T10:26:39,544 adding 'lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml' 2026-02-14T10:26:39,546 adding 'lm_eval/tasks/esbbq/esbbq_nationality.yaml' 2026-02-14T10:26:39,547 adding 'lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml' 2026-02-14T10:26:39,548 adding 'lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml' 2026-02-14T10:26:39,549 adding 'lm_eval/tasks/esbbq/esbbq_religion.yaml' 2026-02-14T10:26:39,550 adding 'lm_eval/tasks/esbbq/esbbq_ses.yaml' 2026-02-14T10:26:39,551 adding 'lm_eval/tasks/esbbq/esbbq_spanish_region.yaml' 2026-02-14T10:26:39,552 adding 'lm_eval/tasks/esbbq/utils.py' 2026-02-14T10:26:39,556 adding 'lm_eval/tasks/eus_exams/README.md' 2026-02-14T10:26:39,557 adding 'lm_eval/tasks/eus_exams/configs.py' 2026-02-14T10:26:39,558 adding 'lm_eval/tasks/eus_exams/eus_exams' 2026-02-14T10:26:39,559 adding 'lm_eval/tasks/eus_exams/eus_exams_es' 2026-02-14T10:26:39,561 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml' 2026-02-14T10:26:39,562 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml' 2026-02-14T10:26:39,563 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml' 2026-02-14T10:26:39,564 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml' 2026-02-14T10:26:39,565 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml' 2026-02-14T10:26:39,566 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml' 2026-02-14T10:26:39,567 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml' 2026-02-14T10:26:39,568 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml' 2026-02-14T10:26:39,569 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml' 2026-02-14T10:26:39,571 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml' 2026-02-14T10:26:39,572 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml' 2026-02-14T10:26:39,573 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml' 2026-02-14T10:26:39,574 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml' 2026-02-14T10:26:39,575 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml' 2026-02-14T10:26:39,576 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml' 2026-02-14T10:26:39,577 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml' 2026-02-14T10:26:39,579 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml' 2026-02-14T10:26:39,580 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml' 2026-02-14T10:26:39,581 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml' 2026-02-14T10:26:39,582 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml' 2026-02-14T10:26:39,583 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml' 2026-02-14T10:26:39,584 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml' 2026-02-14T10:26:39,585 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml' 2026-02-14T10:26:39,587 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml' 2026-02-14T10:26:39,588 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml' 2026-02-14T10:26:39,589 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml' 2026-02-14T10:26:39,590 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml' 2026-02-14T10:26:39,591 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml' 2026-02-14T10:26:39,592 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml' 2026-02-14T10:26:39,594 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml' 2026-02-14T10:26:39,595 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml' 2026-02-14T10:26:39,596 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml' 2026-02-14T10:26:39,597 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml' 2026-02-14T10:26:39,598 adding 'lm_eval/tasks/eus_exams/eus_exams_eu' 2026-02-14T10:26:39,599 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml' 2026-02-14T10:26:39,600 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml' 2026-02-14T10:26:39,601 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml' 2026-02-14T10:26:39,602 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml' 2026-02-14T10:26:39,603 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml' 2026-02-14T10:26:39,604 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml' 2026-02-14T10:26:39,606 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml' 2026-02-14T10:26:39,607 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml' 2026-02-14T10:26:39,608 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml' 2026-02-14T10:26:39,609 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml' 2026-02-14T10:26:39,610 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml' 2026-02-14T10:26:39,611 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml' 2026-02-14T10:26:39,612 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml' 2026-02-14T10:26:39,613 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml' 2026-02-14T10:26:39,615 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml' 2026-02-14T10:26:39,616 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml' 2026-02-14T10:26:39,617 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml' 2026-02-14T10:26:39,618 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml' 2026-02-14T10:26:39,619 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml' 2026-02-14T10:26:39,620 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml' 2026-02-14T10:26:39,621 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml' 2026-02-14T10:26:39,622 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml' 2026-02-14T10:26:39,624 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml' 2026-02-14T10:26:39,625 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml' 2026-02-14T10:26:39,626 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml' 2026-02-14T10:26:39,627 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml' 2026-02-14T10:26:39,628 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml' 2026-02-14T10:26:39,629 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml' 2026-02-14T10:26:39,630 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml' 2026-02-14T10:26:39,632 adding 'lm_eval/tasks/eus_exams/utils.py' 2026-02-14T10:26:39,634 adding 'lm_eval/tasks/eus_proficiency/README.md' 2026-02-14T10:26:39,635 adding 'lm_eval/tasks/eus_proficiency/eus_proficiency.yaml' 2026-02-14T10:26:39,637 adding 'lm_eval/tasks/eus_reading/README.md' 2026-02-14T10:26:39,638 adding 'lm_eval/tasks/eus_reading/eus_reading.yaml' 2026-02-14T10:26:39,639 adding 'lm_eval/tasks/eus_reading/utils.py' 2026-02-14T10:26:39,641 adding 'lm_eval/tasks/eus_trivia/README.md' 2026-02-14T10:26:39,642 adding 'lm_eval/tasks/eus_trivia/eus_trivia.yaml' 2026-02-14T10:26:39,644 adding 'lm_eval/tasks/eus_trivia/utils.py' 2026-02-14T10:26:39,647 adding 'lm_eval/tasks/evalita_llm/README.md' 2026-02-14T10:26:39,649 adding 'lm_eval/tasks/evalita_llm/_at_template_yaml' 2026-02-14T10:26:39,650 adding 'lm_eval/tasks/evalita_llm/_evalita-mp.yaml' 2026-02-14T10:26:39,651 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml' 2026-02-14T10:26:39,652 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml' 2026-02-14T10:26:39,654 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml' 2026-02-14T10:26:39,656 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml' 2026-02-14T10:26:39,657 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml' 2026-02-14T10:26:39,658 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml' 2026-02-14T10:26:39,659 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml' 2026-02-14T10:26:39,660 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml' 2026-02-14T10:26:39,662 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml' 2026-02-14T10:26:39,663 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml' 2026-02-14T10:26:39,664 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml' 2026-02-14T10:26:39,665 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml' 2026-02-14T10:26:39,666 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml' 2026-02-14T10:26:39,668 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml' 2026-02-14T10:26:39,669 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml' 2026-02-14T10:26:39,670 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml' 2026-02-14T10:26:39,671 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml' 2026-02-14T10:26:39,673 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml' 2026-02-14T10:26:39,674 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml' 2026-02-14T10:26:39,675 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml' 2026-02-14T10:26:39,676 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml' 2026-02-14T10:26:39,677 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml' 2026-02-14T10:26:39,679 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml' 2026-02-14T10:26:39,680 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml' 2026-02-14T10:26:39,681 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml' 2026-02-14T10:26:39,682 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml' 2026-02-14T10:26:39,683 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml' 2026-02-14T10:26:39,685 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml' 2026-02-14T10:26:39,686 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml' 2026-02-14T10:26:39,687 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml' 2026-02-14T10:26:39,688 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml' 2026-02-14T10:26:39,690 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml' 2026-02-14T10:26:39,691 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml' 2026-02-14T10:26:39,692 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml' 2026-02-14T10:26:39,693 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml' 2026-02-14T10:26:39,694 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg' 2026-02-14T10:26:39,696 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml' 2026-02-14T10:26:39,697 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml' 2026-02-14T10:26:39,698 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic' 2026-02-14T10:26:39,699 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml' 2026-02-14T10:26:39,701 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml' 2026-02-14T10:26:39,702 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml' 2026-02-14T10:26:39,703 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn' 2026-02-14T10:26:39,704 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml' 2026-02-14T10:26:39,706 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml' 2026-02-14T10:26:39,707 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml' 2026-02-14T10:26:39,708 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml' 2026-02-14T10:26:39,709 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml' 2026-02-14T10:26:39,711 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml' 2026-02-14T10:26:39,712 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml' 2026-02-14T10:26:39,713 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml' 2026-02-14T10:26:39,715 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml' 2026-02-14T10:26:39,716 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml' 2026-02-14T10:26:39,717 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml' 2026-02-14T10:26:39,718 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml' 2026-02-14T10:26:39,719 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml' 2026-02-14T10:26:39,720 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml' 2026-02-14T10:26:39,721 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml' 2026-02-14T10:26:39,722 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml' 2026-02-14T10:26:39,724 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml' 2026-02-14T10:26:39,725 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml' 2026-02-14T10:26:39,726 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml' 2026-02-14T10:26:39,727 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml' 2026-02-14T10:26:39,728 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml' 2026-02-14T10:26:39,730 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml' 2026-02-14T10:26:39,731 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml' 2026-02-14T10:26:39,732 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml' 2026-02-14T10:26:39,733 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml' 2026-02-14T10:26:39,734 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml' 2026-02-14T10:26:39,735 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml' 2026-02-14T10:26:39,737 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml' 2026-02-14T10:26:39,738 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml' 2026-02-14T10:26:39,739 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml' 2026-02-14T10:26:39,740 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml' 2026-02-14T10:26:39,741 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml' 2026-02-14T10:26:39,743 adding 'lm_eval/tasks/evalita_llm/_faq_template_yaml' 2026-02-14T10:26:39,744 adding 'lm_eval/tasks/evalita_llm/_hs_template_yaml' 2026-02-14T10:26:39,745 adding 'lm_eval/tasks/evalita_llm/_ls_template_yaml' 2026-02-14T10:26:39,746 adding 'lm_eval/tasks/evalita_llm/_ner_template_yaml' 2026-02-14T10:26:39,747 adding 'lm_eval/tasks/evalita_llm/_re_template_yaml' 2026-02-14T10:26:39,749 adding 'lm_eval/tasks/evalita_llm/_sa_template_v2_yaml' 2026-02-14T10:26:39,750 adding 'lm_eval/tasks/evalita_llm/_sa_template_yaml' 2026-02-14T10:26:39,751 adding 'lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml' 2026-02-14T10:26:39,752 adding 'lm_eval/tasks/evalita_llm/_sum_template_fp_yaml' 2026-02-14T10:26:39,753 adding 'lm_eval/tasks/evalita_llm/_sum_template_yaml' 2026-02-14T10:26:39,755 adding 'lm_eval/tasks/evalita_llm/_te_template_yaml' 2026-02-14T10:26:39,756 adding 'lm_eval/tasks/evalita_llm/_wic_template_yaml' 2026-02-14T10:26:39,757 adding 'lm_eval/tasks/evalita_llm/metrics.py' 2026-02-14T10:26:39,759 adding 'lm_eval/tasks/evalita_llm/sum_utils.py' 2026-02-14T10:26:39,761 adding 'lm_eval/tasks/evalita_llm/utils.py' 2026-02-14T10:26:39,764 adding 'lm_eval/tasks/fda/README.md' 2026-02-14T10:26:39,765 adding 'lm_eval/tasks/fda/fda.yaml' 2026-02-14T10:26:39,766 adding 'lm_eval/tasks/fda/task.py' 2026-02-14T10:26:39,768 adding 'lm_eval/tasks/fld/README.md' 2026-02-14T10:26:39,770 adding 'lm_eval/tasks/fld/fld_default.yaml' 2026-02-14T10:26:39,771 adding 'lm_eval/tasks/fld/fld_logical_formula_default.yaml' 2026-02-14T10:26:39,772 adding 'lm_eval/tasks/fld/fld_logical_formula_star.yaml' 2026-02-14T10:26:39,773 adding 'lm_eval/tasks/fld/fld_star.yaml' 2026-02-14T10:26:39,776 adding 'lm_eval/tasks/french_bench/README.md' 2026-02-14T10:26:39,777 adding 'lm_eval/tasks/french_bench/_default_template_yaml' 2026-02-14T10:26:39,778 adding 'lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml' 2026-02-14T10:26:39,779 adding 'lm_eval/tasks/french_bench/french_bench_boolqa.yaml' 2026-02-14T10:26:39,781 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2.yaml' 2026-02-14T10:26:39,782 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml' 2026-02-14T10:26:39,783 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml' 2026-02-14T10:26:39,784 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml' 2026-02-14T10:26:39,785 adding 'lm_eval/tasks/french_bench/french_bench_grammar.yaml' 2026-02-14T10:26:39,787 adding 'lm_eval/tasks/french_bench/french_bench_hellaswag.yaml' 2026-02-14T10:26:39,788 adding 'lm_eval/tasks/french_bench/french_bench_multifquad.yaml' 2026-02-14T10:26:39,789 adding 'lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml' 2026-02-14T10:26:39,790 adding 'lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml' 2026-02-14T10:26:39,791 adding 'lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml' 2026-02-14T10:26:39,793 adding 'lm_eval/tasks/french_bench/french_bench_reading_comp.yaml' 2026-02-14T10:26:39,794 adding 'lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml' 2026-02-14T10:26:39,795 adding 'lm_eval/tasks/french_bench/french_bench_trivia.yaml' 2026-02-14T10:26:39,797 adding 'lm_eval/tasks/french_bench/french_bench_vocab.yaml' 2026-02-14T10:26:39,798 adding 'lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml' 2026-02-14T10:26:39,799 adding 'lm_eval/tasks/french_bench/french_bench_xnli.yaml' 2026-02-14T10:26:39,800 adding 'lm_eval/tasks/french_bench/preprocess_wikitext.py' 2026-02-14T10:26:39,802 adding 'lm_eval/tasks/french_bench/utils.py' 2026-02-14T10:26:39,804 adding 'lm_eval/tasks/galician_bench/README.md' 2026-02-14T10:26:39,805 adding 'lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml' 2026-02-14T10:26:39,806 adding 'lm_eval/tasks/galician_bench/galcola.yaml' 2026-02-14T10:26:39,807 adding 'lm_eval/tasks/galician_bench/galician_bench.yaml' 2026-02-14T10:26:39,809 adding 'lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml' 2026-02-14T10:26:39,810 adding 'lm_eval/tasks/galician_bench/openbookqa_gl.yaml' 2026-02-14T10:26:39,811 adding 'lm_eval/tasks/galician_bench/parafrases_gl.yaml' 2026-02-14T10:26:39,812 adding 'lm_eval/tasks/galician_bench/paws_gl.yaml' 2026-02-14T10:26:39,814 adding 'lm_eval/tasks/galician_bench/summarization_gl.yaml' 2026-02-14T10:26:39,815 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml' 2026-02-14T10:26:39,816 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml' 2026-02-14T10:26:39,817 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml' 2026-02-14T10:26:39,819 adding 'lm_eval/tasks/galician_bench/utils.py' 2026-02-14T10:26:39,821 adding 'lm_eval/tasks/galician_bench/xnli_gl.yaml' 2026-02-14T10:26:39,822 adding 'lm_eval/tasks/galician_bench/xstorycloze_gl.yaml' 2026-02-14T10:26:39,824 adding 'lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml' 2026-02-14T10:26:39,826 adding 'lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py' 2026-02-14T10:26:39,827 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml' 2026-02-14T10:26:39,828 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml' 2026-02-14T10:26:39,829 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml' 2026-02-14T10:26:39,830 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml' 2026-02-14T10:26:39,832 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml' 2026-02-14T10:26:39,833 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml' 2026-02-14T10:26:39,834 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml' 2026-02-14T10:26:39,835 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml' 2026-02-14T10:26:39,837 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml' 2026-02-14T10:26:39,838 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml' 2026-02-14T10:26:39,839 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml' 2026-02-14T10:26:39,840 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml' 2026-02-14T10:26:39,841 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml' 2026-02-14T10:26:39,842 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml' 2026-02-14T10:26:39,843 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml' 2026-02-14T10:26:39,844 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml' 2026-02-14T10:26:39,845 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml' 2026-02-14T10:26:39,847 adding 'lm_eval/tasks/glianorex/README.md' 2026-02-14T10:26:39,848 adding 'lm_eval/tasks/glianorex/glianorex.yaml' 2026-02-14T10:26:39,849 adding 'lm_eval/tasks/glianorex/glianorex_en.yaml' 2026-02-14T10:26:39,851 adding 'lm_eval/tasks/glianorex/glianorex_fr.yaml' 2026-02-14T10:26:39,852 adding 'lm_eval/tasks/glianorex/preprocess_glianorex.py' 2026-02-14T10:26:39,853 adding 'lm_eval/tasks/global_mmlu/README.md' 2026-02-14T10:26:39,856 adding 'lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml' 2026-02-14T10:26:39,857 adding 'lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml' 2026-02-14T10:26:39,858 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml' 2026-02-14T10:26:39,859 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml' 2026-02-14T10:26:39,860 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml' 2026-02-14T10:26:39,861 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml' 2026-02-14T10:26:39,863 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml' 2026-02-14T10:26:39,864 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml' 2026-02-14T10:26:39,865 adding 'lm_eval/tasks/global_mmlu/default/ar/utils.py' 2026-02-14T10:26:39,867 adding 'lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml' 2026-02-14T10:26:39,868 adding 'lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml' 2026-02-14T10:26:39,869 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml' 2026-02-14T10:26:39,870 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml' 2026-02-14T10:26:39,871 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml' 2026-02-14T10:26:39,872 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml' 2026-02-14T10:26:39,874 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml' 2026-02-14T10:26:39,875 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml' 2026-02-14T10:26:39,876 adding 'lm_eval/tasks/global_mmlu/default/bn/utils.py' 2026-02-14T10:26:39,878 adding 'lm_eval/tasks/global_mmlu/default/de/_de_template_yaml' 2026-02-14T10:26:39,879 adding 'lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml' 2026-02-14T10:26:39,880 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml' 2026-02-14T10:26:39,882 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml' 2026-02-14T10:26:39,883 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml' 2026-02-14T10:26:39,884 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml' 2026-02-14T10:26:39,885 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml' 2026-02-14T10:26:39,886 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml' 2026-02-14T10:26:39,888 adding 'lm_eval/tasks/global_mmlu/default/de/utils.py' 2026-02-14T10:26:39,889 adding 'lm_eval/tasks/global_mmlu/default/en/_en_template_yaml' 2026-02-14T10:26:39,891 adding 'lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml' 2026-02-14T10:26:39,892 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml' 2026-02-14T10:26:39,893 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml' 2026-02-14T10:26:39,894 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml' 2026-02-14T10:26:39,895 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml' 2026-02-14T10:26:39,897 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml' 2026-02-14T10:26:39,898 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml' 2026-02-14T10:26:39,899 adding 'lm_eval/tasks/global_mmlu/default/en/utils.py' 2026-02-14T10:26:39,901 adding 'lm_eval/tasks/global_mmlu/default/es/_es_template_yaml' 2026-02-14T10:26:39,902 adding 'lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml' 2026-02-14T10:26:39,903 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml' 2026-02-14T10:26:39,904 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml' 2026-02-14T10:26:39,905 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml' 2026-02-14T10:26:39,906 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml' 2026-02-14T10:26:39,907 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml' 2026-02-14T10:26:39,909 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml' 2026-02-14T10:26:39,910 adding 'lm_eval/tasks/global_mmlu/default/es/utils.py' 2026-02-14T10:26:39,911 adding 'lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml' 2026-02-14T10:26:39,913 adding 'lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml' 2026-02-14T10:26:39,914 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml' 2026-02-14T10:26:39,915 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml' 2026-02-14T10:26:39,916 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml' 2026-02-14T10:26:39,917 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml' 2026-02-14T10:26:39,918 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml' 2026-02-14T10:26:39,919 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml' 2026-02-14T10:26:39,921 adding 'lm_eval/tasks/global_mmlu/default/fr/utils.py' 2026-02-14T10:26:39,922 adding 'lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml' 2026-02-14T10:26:39,924 adding 'lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml' 2026-02-14T10:26:39,925 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml' 2026-02-14T10:26:39,926 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml' 2026-02-14T10:26:39,927 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml' 2026-02-14T10:26:39,929 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml' 2026-02-14T10:26:39,930 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml' 2026-02-14T10:26:39,931 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml' 2026-02-14T10:26:39,932 adding 'lm_eval/tasks/global_mmlu/default/hi/utils.py' 2026-02-14T10:26:39,934 adding 'lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml' 2026-02-14T10:26:39,935 adding 'lm_eval/tasks/global_mmlu/default/id/_id_template_yaml' 2026-02-14T10:26:39,937 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml' 2026-02-14T10:26:39,938 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml' 2026-02-14T10:26:39,939 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml' 2026-02-14T10:26:39,940 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml' 2026-02-14T10:26:39,941 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml' 2026-02-14T10:26:39,942 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml' 2026-02-14T10:26:39,944 adding 'lm_eval/tasks/global_mmlu/default/id/utils.py' 2026-02-14T10:26:39,946 adding 'lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml' 2026-02-14T10:26:39,947 adding 'lm_eval/tasks/global_mmlu/default/it/_it_template_yaml' 2026-02-14T10:26:39,948 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml' 2026-02-14T10:26:39,949 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml' 2026-02-14T10:26:39,950 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml' 2026-02-14T10:26:39,951 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml' 2026-02-14T10:26:39,952 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml' 2026-02-14T10:26:39,953 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml' 2026-02-14T10:26:39,955 adding 'lm_eval/tasks/global_mmlu/default/it/utils.py' 2026-02-14T10:26:39,956 adding 'lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml' 2026-02-14T10:26:39,957 adding 'lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml' 2026-02-14T10:26:39,959 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml' 2026-02-14T10:26:39,960 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml' 2026-02-14T10:26:39,961 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml' 2026-02-14T10:26:39,962 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml' 2026-02-14T10:26:39,963 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml' 2026-02-14T10:26:39,964 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml' 2026-02-14T10:26:39,966 adding 'lm_eval/tasks/global_mmlu/default/ja/utils.py' 2026-02-14T10:26:39,967 adding 'lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml' 2026-02-14T10:26:39,969 adding 'lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml' 2026-02-14T10:26:39,970 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml' 2026-02-14T10:26:39,971 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml' 2026-02-14T10:26:39,972 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml' 2026-02-14T10:26:39,973 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml' 2026-02-14T10:26:39,974 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml' 2026-02-14T10:26:39,976 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml' 2026-02-14T10:26:39,977 adding 'lm_eval/tasks/global_mmlu/default/ko/utils.py' 2026-02-14T10:26:39,979 adding 'lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml' 2026-02-14T10:26:39,980 adding 'lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml' 2026-02-14T10:26:39,981 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml' 2026-02-14T10:26:39,982 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml' 2026-02-14T10:26:39,983 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml' 2026-02-14T10:26:39,984 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml' 2026-02-14T10:26:39,986 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml' 2026-02-14T10:26:39,987 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml' 2026-02-14T10:26:39,988 adding 'lm_eval/tasks/global_mmlu/default/pt/utils.py' 2026-02-14T10:26:39,990 adding 'lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml' 2026-02-14T10:26:39,991 adding 'lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml' 2026-02-14T10:26:39,993 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml' 2026-02-14T10:26:39,994 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml' 2026-02-14T10:26:39,995 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml' 2026-02-14T10:26:39,996 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml' 2026-02-14T10:26:39,997 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml' 2026-02-14T10:26:39,999 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml' 2026-02-14T10:26:40,000 adding 'lm_eval/tasks/global_mmlu/default/sw/utils.py' 2026-02-14T10:26:40,002 adding 'lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml' 2026-02-14T10:26:40,003 adding 'lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml' 2026-02-14T10:26:40,004 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml' 2026-02-14T10:26:40,005 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml' 2026-02-14T10:26:40,006 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml' 2026-02-14T10:26:40,007 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml' 2026-02-14T10:26:40,008 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml' 2026-02-14T10:26:40,009 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml' 2026-02-14T10:26:40,010 adding 'lm_eval/tasks/global_mmlu/default/yo/utils.py' 2026-02-14T10:26:40,012 adding 'lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml' 2026-02-14T10:26:40,013 adding 'lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml' 2026-02-14T10:26:40,014 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml' 2026-02-14T10:26:40,016 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml' 2026-02-14T10:26:40,017 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml' 2026-02-14T10:26:40,018 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml' 2026-02-14T10:26:40,019 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml' 2026-02-14T10:26:40,020 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml' 2026-02-14T10:26:40,021 adding 'lm_eval/tasks/global_mmlu/default/zh/utils.py' 2026-02-14T10:26:40,025 adding 'lm_eval/tasks/global_mmlu/full/am/_am_template_yaml' 2026-02-14T10:26:40,027 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml' 2026-02-14T10:26:40,028 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml' 2026-02-14T10:26:40,029 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml' 2026-02-14T10:26:40,030 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml' 2026-02-14T10:26:40,031 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml' 2026-02-14T10:26:40,032 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml' 2026-02-14T10:26:40,033 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml' 2026-02-14T10:26:40,035 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml' 2026-02-14T10:26:40,036 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml' 2026-02-14T10:26:40,037 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml' 2026-02-14T10:26:40,038 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml' 2026-02-14T10:26:40,039 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml' 2026-02-14T10:26:40,040 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml' 2026-02-14T10:26:40,042 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml' 2026-02-14T10:26:40,043 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml' 2026-02-14T10:26:40,044 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml' 2026-02-14T10:26:40,045 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml' 2026-02-14T10:26:40,047 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml' 2026-02-14T10:26:40,048 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml' 2026-02-14T10:26:40,049 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml' 2026-02-14T10:26:40,050 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml' 2026-02-14T10:26:40,051 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml' 2026-02-14T10:26:40,053 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml' 2026-02-14T10:26:40,054 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml' 2026-02-14T10:26:40,055 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml' 2026-02-14T10:26:40,056 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml' 2026-02-14T10:26:40,057 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml' 2026-02-14T10:26:40,058 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml' 2026-02-14T10:26:40,059 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,060 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,062 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml' 2026-02-14T10:26:40,063 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml' 2026-02-14T10:26:40,064 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml' 2026-02-14T10:26:40,065 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml' 2026-02-14T10:26:40,066 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml' 2026-02-14T10:26:40,068 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml' 2026-02-14T10:26:40,069 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml' 2026-02-14T10:26:40,070 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml' 2026-02-14T10:26:40,071 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml' 2026-02-14T10:26:40,072 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml' 2026-02-14T10:26:40,073 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml' 2026-02-14T10:26:40,075 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml' 2026-02-14T10:26:40,076 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml' 2026-02-14T10:26:40,077 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml' 2026-02-14T10:26:40,078 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml' 2026-02-14T10:26:40,079 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml' 2026-02-14T10:26:40,081 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml' 2026-02-14T10:26:40,082 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml' 2026-02-14T10:26:40,083 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml' 2026-02-14T10:26:40,084 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml' 2026-02-14T10:26:40,085 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml' 2026-02-14T10:26:40,086 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml' 2026-02-14T10:26:40,088 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml' 2026-02-14T10:26:40,089 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml' 2026-02-14T10:26:40,090 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml' 2026-02-14T10:26:40,091 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml' 2026-02-14T10:26:40,092 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml' 2026-02-14T10:26:40,094 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml' 2026-02-14T10:26:40,095 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml' 2026-02-14T10:26:40,096 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml' 2026-02-14T10:26:40,097 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml' 2026-02-14T10:26:40,098 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml' 2026-02-14T10:26:40,099 adding 'lm_eval/tasks/global_mmlu/full/am/utils.py' 2026-02-14T10:26:40,102 adding 'lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml' 2026-02-14T10:26:40,103 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml' 2026-02-14T10:26:40,104 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml' 2026-02-14T10:26:40,105 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml' 2026-02-14T10:26:40,106 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml' 2026-02-14T10:26:40,108 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml' 2026-02-14T10:26:40,109 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml' 2026-02-14T10:26:40,110 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml' 2026-02-14T10:26:40,111 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml' 2026-02-14T10:26:40,112 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml' 2026-02-14T10:26:40,113 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml' 2026-02-14T10:26:40,114 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml' 2026-02-14T10:26:40,116 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml' 2026-02-14T10:26:40,118 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml' 2026-02-14T10:26:40,119 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml' 2026-02-14T10:26:40,120 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml' 2026-02-14T10:26:40,122 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml' 2026-02-14T10:26:40,123 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml' 2026-02-14T10:26:40,124 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml' 2026-02-14T10:26:40,125 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml' 2026-02-14T10:26:40,126 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml' 2026-02-14T10:26:40,128 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml' 2026-02-14T10:26:40,129 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml' 2026-02-14T10:26:40,130 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml' 2026-02-14T10:26:40,131 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml' 2026-02-14T10:26:40,132 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml' 2026-02-14T10:26:40,134 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml' 2026-02-14T10:26:40,135 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml' 2026-02-14T10:26:40,136 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml' 2026-02-14T10:26:40,137 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,138 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,140 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml' 2026-02-14T10:26:40,141 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml' 2026-02-14T10:26:40,142 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml' 2026-02-14T10:26:40,143 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml' 2026-02-14T10:26:40,144 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml' 2026-02-14T10:26:40,145 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml' 2026-02-14T10:26:40,146 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml' 2026-02-14T10:26:40,148 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml' 2026-02-14T10:26:40,149 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml' 2026-02-14T10:26:40,150 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml' 2026-02-14T10:26:40,151 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml' 2026-02-14T10:26:40,152 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml' 2026-02-14T10:26:40,153 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml' 2026-02-14T10:26:40,155 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml' 2026-02-14T10:26:40,156 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml' 2026-02-14T10:26:40,157 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml' 2026-02-14T10:26:40,158 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml' 2026-02-14T10:26:40,159 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml' 2026-02-14T10:26:40,160 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml' 2026-02-14T10:26:40,162 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml' 2026-02-14T10:26:40,163 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml' 2026-02-14T10:26:40,164 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml' 2026-02-14T10:26:40,165 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml' 2026-02-14T10:26:40,167 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml' 2026-02-14T10:26:40,168 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml' 2026-02-14T10:26:40,169 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml' 2026-02-14T10:26:40,170 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml' 2026-02-14T10:26:40,172 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml' 2026-02-14T10:26:40,173 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml' 2026-02-14T10:26:40,174 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml' 2026-02-14T10:26:40,175 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml' 2026-02-14T10:26:40,177 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml' 2026-02-14T10:26:40,178 adding 'lm_eval/tasks/global_mmlu/full/ar/utils.py' 2026-02-14T10:26:40,181 adding 'lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml' 2026-02-14T10:26:40,182 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml' 2026-02-14T10:26:40,184 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml' 2026-02-14T10:26:40,185 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml' 2026-02-14T10:26:40,186 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml' 2026-02-14T10:26:40,188 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml' 2026-02-14T10:26:40,189 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml' 2026-02-14T10:26:40,190 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml' 2026-02-14T10:26:40,191 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml' 2026-02-14T10:26:40,192 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml' 2026-02-14T10:26:40,193 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml' 2026-02-14T10:26:40,194 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml' 2026-02-14T10:26:40,196 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml' 2026-02-14T10:26:40,197 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml' 2026-02-14T10:26:40,198 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml' 2026-02-14T10:26:40,199 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml' 2026-02-14T10:26:40,200 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml' 2026-02-14T10:26:40,202 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml' 2026-02-14T10:26:40,203 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml' 2026-02-14T10:26:40,204 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml' 2026-02-14T10:26:40,205 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml' 2026-02-14T10:26:40,206 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml' 2026-02-14T10:26:40,207 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml' 2026-02-14T10:26:40,209 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml' 2026-02-14T10:26:40,210 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml' 2026-02-14T10:26:40,211 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml' 2026-02-14T10:26:40,212 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml' 2026-02-14T10:26:40,213 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml' 2026-02-14T10:26:40,214 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml' 2026-02-14T10:26:40,216 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,217 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,218 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml' 2026-02-14T10:26:40,219 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml' 2026-02-14T10:26:40,221 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml' 2026-02-14T10:26:40,222 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml' 2026-02-14T10:26:40,223 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml' 2026-02-14T10:26:40,224 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml' 2026-02-14T10:26:40,225 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml' 2026-02-14T10:26:40,227 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml' 2026-02-14T10:26:40,228 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml' 2026-02-14T10:26:40,229 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml' 2026-02-14T10:26:40,230 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml' 2026-02-14T10:26:40,231 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml' 2026-02-14T10:26:40,232 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml' 2026-02-14T10:26:40,234 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml' 2026-02-14T10:26:40,235 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml' 2026-02-14T10:26:40,236 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml' 2026-02-14T10:26:40,237 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml' 2026-02-14T10:26:40,238 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml' 2026-02-14T10:26:40,239 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml' 2026-02-14T10:26:40,241 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml' 2026-02-14T10:26:40,242 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml' 2026-02-14T10:26:40,243 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml' 2026-02-14T10:26:40,244 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml' 2026-02-14T10:26:40,245 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml' 2026-02-14T10:26:40,247 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml' 2026-02-14T10:26:40,248 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml' 2026-02-14T10:26:40,249 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml' 2026-02-14T10:26:40,250 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml' 2026-02-14T10:26:40,251 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml' 2026-02-14T10:26:40,252 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml' 2026-02-14T10:26:40,254 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml' 2026-02-14T10:26:40,255 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml' 2026-02-14T10:26:40,256 adding 'lm_eval/tasks/global_mmlu/full/bn/utils.py' 2026-02-14T10:26:40,259 adding 'lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml' 2026-02-14T10:26:40,260 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml' 2026-02-14T10:26:40,261 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml' 2026-02-14T10:26:40,263 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml' 2026-02-14T10:26:40,264 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml' 2026-02-14T10:26:40,265 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml' 2026-02-14T10:26:40,266 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml' 2026-02-14T10:26:40,267 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml' 2026-02-14T10:26:40,269 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml' 2026-02-14T10:26:40,270 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml' 2026-02-14T10:26:40,271 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml' 2026-02-14T10:26:40,272 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml' 2026-02-14T10:26:40,274 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml' 2026-02-14T10:26:40,275 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml' 2026-02-14T10:26:40,277 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml' 2026-02-14T10:26:40,278 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml' 2026-02-14T10:26:40,279 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml' 2026-02-14T10:26:40,280 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml' 2026-02-14T10:26:40,281 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml' 2026-02-14T10:26:40,283 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml' 2026-02-14T10:26:40,284 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml' 2026-02-14T10:26:40,285 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml' 2026-02-14T10:26:40,286 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml' 2026-02-14T10:26:40,287 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml' 2026-02-14T10:26:40,288 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml' 2026-02-14T10:26:40,290 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml' 2026-02-14T10:26:40,291 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml' 2026-02-14T10:26:40,292 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml' 2026-02-14T10:26:40,293 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml' 2026-02-14T10:26:40,294 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,296 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,297 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml' 2026-02-14T10:26:40,298 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml' 2026-02-14T10:26:40,299 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml' 2026-02-14T10:26:40,300 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml' 2026-02-14T10:26:40,302 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml' 2026-02-14T10:26:40,303 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml' 2026-02-14T10:26:40,304 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml' 2026-02-14T10:26:40,305 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml' 2026-02-14T10:26:40,307 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml' 2026-02-14T10:26:40,308 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml' 2026-02-14T10:26:40,309 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml' 2026-02-14T10:26:40,310 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml' 2026-02-14T10:26:40,311 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml' 2026-02-14T10:26:40,313 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml' 2026-02-14T10:26:40,314 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml' 2026-02-14T10:26:40,315 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml' 2026-02-14T10:26:40,316 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml' 2026-02-14T10:26:40,318 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml' 2026-02-14T10:26:40,319 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml' 2026-02-14T10:26:40,320 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml' 2026-02-14T10:26:40,322 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml' 2026-02-14T10:26:40,323 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml' 2026-02-14T10:26:40,324 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml' 2026-02-14T10:26:40,325 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml' 2026-02-14T10:26:40,326 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml' 2026-02-14T10:26:40,327 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml' 2026-02-14T10:26:40,328 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml' 2026-02-14T10:26:40,329 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml' 2026-02-14T10:26:40,330 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml' 2026-02-14T10:26:40,332 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml' 2026-02-14T10:26:40,333 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml' 2026-02-14T10:26:40,334 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml' 2026-02-14T10:26:40,335 adding 'lm_eval/tasks/global_mmlu/full/cs/utils.py' 2026-02-14T10:26:40,338 adding 'lm_eval/tasks/global_mmlu/full/de/_de_template_yaml' 2026-02-14T10:26:40,339 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml' 2026-02-14T10:26:40,341 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml' 2026-02-14T10:26:40,342 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml' 2026-02-14T10:26:40,343 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml' 2026-02-14T10:26:40,344 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml' 2026-02-14T10:26:40,345 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml' 2026-02-14T10:26:40,347 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml' 2026-02-14T10:26:40,348 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml' 2026-02-14T10:26:40,349 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml' 2026-02-14T10:26:40,350 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml' 2026-02-14T10:26:40,351 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml' 2026-02-14T10:26:40,352 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml' 2026-02-14T10:26:40,354 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml' 2026-02-14T10:26:40,355 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml' 2026-02-14T10:26:40,356 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml' 2026-02-14T10:26:40,357 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml' 2026-02-14T10:26:40,359 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml' 2026-02-14T10:26:40,360 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml' 2026-02-14T10:26:40,361 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml' 2026-02-14T10:26:40,362 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml' 2026-02-14T10:26:40,364 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml' 2026-02-14T10:26:40,365 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml' 2026-02-14T10:26:40,366 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml' 2026-02-14T10:26:40,367 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml' 2026-02-14T10:26:40,369 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml' 2026-02-14T10:26:40,370 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml' 2026-02-14T10:26:40,371 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml' 2026-02-14T10:26:40,372 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml' 2026-02-14T10:26:40,373 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,374 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,376 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml' 2026-02-14T10:26:40,377 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml' 2026-02-14T10:26:40,378 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml' 2026-02-14T10:26:40,379 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml' 2026-02-14T10:26:40,380 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml' 2026-02-14T10:26:40,382 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml' 2026-02-14T10:26:40,383 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml' 2026-02-14T10:26:40,384 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml' 2026-02-14T10:26:40,385 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml' 2026-02-14T10:26:40,386 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml' 2026-02-14T10:26:40,387 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml' 2026-02-14T10:26:40,389 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml' 2026-02-14T10:26:40,390 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml' 2026-02-14T10:26:40,391 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml' 2026-02-14T10:26:40,392 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml' 2026-02-14T10:26:40,393 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml' 2026-02-14T10:26:40,395 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml' 2026-02-14T10:26:40,396 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml' 2026-02-14T10:26:40,397 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml' 2026-02-14T10:26:40,398 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml' 2026-02-14T10:26:40,399 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml' 2026-02-14T10:26:40,401 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml' 2026-02-14T10:26:40,402 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml' 2026-02-14T10:26:40,403 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml' 2026-02-14T10:26:40,404 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml' 2026-02-14T10:26:40,405 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml' 2026-02-14T10:26:40,406 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml' 2026-02-14T10:26:40,408 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml' 2026-02-14T10:26:40,409 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml' 2026-02-14T10:26:40,410 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml' 2026-02-14T10:26:40,411 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml' 2026-02-14T10:26:40,412 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml' 2026-02-14T10:26:40,414 adding 'lm_eval/tasks/global_mmlu/full/de/utils.py' 2026-02-14T10:26:40,417 adding 'lm_eval/tasks/global_mmlu/full/el/_el_template_yaml' 2026-02-14T10:26:40,418 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml' 2026-02-14T10:26:40,419 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml' 2026-02-14T10:26:40,420 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml' 2026-02-14T10:26:40,421 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml' 2026-02-14T10:26:40,423 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml' 2026-02-14T10:26:40,424 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml' 2026-02-14T10:26:40,425 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml' 2026-02-14T10:26:40,427 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml' 2026-02-14T10:26:40,428 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml' 2026-02-14T10:26:40,429 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml' 2026-02-14T10:26:40,430 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml' 2026-02-14T10:26:40,431 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml' 2026-02-14T10:26:40,433 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml' 2026-02-14T10:26:40,434 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml' 2026-02-14T10:26:40,435 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml' 2026-02-14T10:26:40,436 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml' 2026-02-14T10:26:40,437 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml' 2026-02-14T10:26:40,438 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml' 2026-02-14T10:26:40,440 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml' 2026-02-14T10:26:40,441 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml' 2026-02-14T10:26:40,442 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml' 2026-02-14T10:26:40,443 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml' 2026-02-14T10:26:40,444 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml' 2026-02-14T10:26:40,445 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml' 2026-02-14T10:26:40,447 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml' 2026-02-14T10:26:40,448 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml' 2026-02-14T10:26:40,449 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml' 2026-02-14T10:26:40,450 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml' 2026-02-14T10:26:40,452 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,453 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,454 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml' 2026-02-14T10:26:40,455 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml' 2026-02-14T10:26:40,456 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml' 2026-02-14T10:26:40,458 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml' 2026-02-14T10:26:40,459 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml' 2026-02-14T10:26:40,460 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml' 2026-02-14T10:26:40,461 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml' 2026-02-14T10:26:40,462 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml' 2026-02-14T10:26:40,463 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml' 2026-02-14T10:26:40,465 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml' 2026-02-14T10:26:40,466 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml' 2026-02-14T10:26:40,467 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml' 2026-02-14T10:26:40,468 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml' 2026-02-14T10:26:40,469 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml' 2026-02-14T10:26:40,471 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml' 2026-02-14T10:26:40,472 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml' 2026-02-14T10:26:40,473 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml' 2026-02-14T10:26:40,474 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml' 2026-02-14T10:26:40,476 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml' 2026-02-14T10:26:40,477 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml' 2026-02-14T10:26:40,478 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml' 2026-02-14T10:26:40,479 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml' 2026-02-14T10:26:40,480 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml' 2026-02-14T10:26:40,481 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml' 2026-02-14T10:26:40,483 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml' 2026-02-14T10:26:40,484 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml' 2026-02-14T10:26:40,485 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml' 2026-02-14T10:26:40,486 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml' 2026-02-14T10:26:40,487 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml' 2026-02-14T10:26:40,489 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml' 2026-02-14T10:26:40,490 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml' 2026-02-14T10:26:40,491 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml' 2026-02-14T10:26:40,492 adding 'lm_eval/tasks/global_mmlu/full/el/utils.py' 2026-02-14T10:26:40,495 adding 'lm_eval/tasks/global_mmlu/full/en/_en_template_yaml' 2026-02-14T10:26:40,497 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml' 2026-02-14T10:26:40,498 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml' 2026-02-14T10:26:40,499 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml' 2026-02-14T10:26:40,500 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml' 2026-02-14T10:26:40,502 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml' 2026-02-14T10:26:40,503 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml' 2026-02-14T10:26:40,504 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml' 2026-02-14T10:26:40,506 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml' 2026-02-14T10:26:40,507 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml' 2026-02-14T10:26:40,508 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml' 2026-02-14T10:26:40,509 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml' 2026-02-14T10:26:40,510 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml' 2026-02-14T10:26:40,511 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml' 2026-02-14T10:26:40,512 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml' 2026-02-14T10:26:40,513 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml' 2026-02-14T10:26:40,514 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml' 2026-02-14T10:26:40,516 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml' 2026-02-14T10:26:40,517 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml' 2026-02-14T10:26:40,518 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml' 2026-02-14T10:26:40,519 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml' 2026-02-14T10:26:40,520 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml' 2026-02-14T10:26:40,521 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml' 2026-02-14T10:26:40,522 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml' 2026-02-14T10:26:40,524 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml' 2026-02-14T10:26:40,525 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml' 2026-02-14T10:26:40,526 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml' 2026-02-14T10:26:40,527 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml' 2026-02-14T10:26:40,528 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml' 2026-02-14T10:26:40,530 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,531 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,532 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml' 2026-02-14T10:26:40,533 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml' 2026-02-14T10:26:40,534 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml' 2026-02-14T10:26:40,536 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml' 2026-02-14T10:26:40,537 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml' 2026-02-14T10:26:40,538 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml' 2026-02-14T10:26:40,539 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml' 2026-02-14T10:26:40,540 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml' 2026-02-14T10:26:40,541 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml' 2026-02-14T10:26:40,543 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml' 2026-02-14T10:26:40,544 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml' 2026-02-14T10:26:40,545 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml' 2026-02-14T10:26:40,546 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml' 2026-02-14T10:26:40,547 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml' 2026-02-14T10:26:40,548 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml' 2026-02-14T10:26:40,549 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml' 2026-02-14T10:26:40,550 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml' 2026-02-14T10:26:40,552 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml' 2026-02-14T10:26:40,553 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml' 2026-02-14T10:26:40,554 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml' 2026-02-14T10:26:40,555 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml' 2026-02-14T10:26:40,556 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml' 2026-02-14T10:26:40,557 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml' 2026-02-14T10:26:40,558 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml' 2026-02-14T10:26:40,560 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml' 2026-02-14T10:26:40,561 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml' 2026-02-14T10:26:40,562 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml' 2026-02-14T10:26:40,563 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml' 2026-02-14T10:26:40,564 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml' 2026-02-14T10:26:40,565 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml' 2026-02-14T10:26:40,566 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml' 2026-02-14T10:26:40,568 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml' 2026-02-14T10:26:40,569 adding 'lm_eval/tasks/global_mmlu/full/en/utils.py' 2026-02-14T10:26:40,572 adding 'lm_eval/tasks/global_mmlu/full/es/_es_template_yaml' 2026-02-14T10:26:40,573 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml' 2026-02-14T10:26:40,574 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml' 2026-02-14T10:26:40,576 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml' 2026-02-14T10:26:40,577 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml' 2026-02-14T10:26:40,578 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml' 2026-02-14T10:26:40,579 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml' 2026-02-14T10:26:40,580 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml' 2026-02-14T10:26:40,582 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml' 2026-02-14T10:26:40,583 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml' 2026-02-14T10:26:40,584 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml' 2026-02-14T10:26:40,585 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml' 2026-02-14T10:26:40,586 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml' 2026-02-14T10:26:40,588 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml' 2026-02-14T10:26:40,589 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml' 2026-02-14T10:26:40,590 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml' 2026-02-14T10:26:40,591 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml' 2026-02-14T10:26:40,592 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml' 2026-02-14T10:26:40,594 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml' 2026-02-14T10:26:40,595 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml' 2026-02-14T10:26:40,596 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml' 2026-02-14T10:26:40,597 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml' 2026-02-14T10:26:40,598 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml' 2026-02-14T10:26:40,599 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml' 2026-02-14T10:26:40,600 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml' 2026-02-14T10:26:40,602 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml' 2026-02-14T10:26:40,603 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml' 2026-02-14T10:26:40,604 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml' 2026-02-14T10:26:40,605 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml' 2026-02-14T10:26:40,606 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,607 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,608 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml' 2026-02-14T10:26:40,610 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml' 2026-02-14T10:26:40,611 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml' 2026-02-14T10:26:40,612 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml' 2026-02-14T10:26:40,613 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml' 2026-02-14T10:26:40,614 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml' 2026-02-14T10:26:40,616 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml' 2026-02-14T10:26:40,617 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml' 2026-02-14T10:26:40,618 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml' 2026-02-14T10:26:40,619 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml' 2026-02-14T10:26:40,620 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml' 2026-02-14T10:26:40,621 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml' 2026-02-14T10:26:40,623 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml' 2026-02-14T10:26:40,624 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml' 2026-02-14T10:26:40,625 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml' 2026-02-14T10:26:40,626 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml' 2026-02-14T10:26:40,627 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml' 2026-02-14T10:26:40,629 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml' 2026-02-14T10:26:40,630 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml' 2026-02-14T10:26:40,631 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml' 2026-02-14T10:26:40,632 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml' 2026-02-14T10:26:40,633 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml' 2026-02-14T10:26:40,635 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml' 2026-02-14T10:26:40,636 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml' 2026-02-14T10:26:40,637 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml' 2026-02-14T10:26:40,638 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml' 2026-02-14T10:26:40,639 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml' 2026-02-14T10:26:40,640 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml' 2026-02-14T10:26:40,641 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml' 2026-02-14T10:26:40,643 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml' 2026-02-14T10:26:40,644 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml' 2026-02-14T10:26:40,645 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml' 2026-02-14T10:26:40,646 adding 'lm_eval/tasks/global_mmlu/full/es/utils.py' 2026-02-14T10:26:40,649 adding 'lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml' 2026-02-14T10:26:40,650 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml' 2026-02-14T10:26:40,651 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml' 2026-02-14T10:26:40,653 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml' 2026-02-14T10:26:40,654 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml' 2026-02-14T10:26:40,655 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml' 2026-02-14T10:26:40,656 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml' 2026-02-14T10:26:40,657 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml' 2026-02-14T10:26:40,658 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml' 2026-02-14T10:26:40,659 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml' 2026-02-14T10:26:40,661 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml' 2026-02-14T10:26:40,662 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml' 2026-02-14T10:26:40,663 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml' 2026-02-14T10:26:40,664 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml' 2026-02-14T10:26:40,666 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml' 2026-02-14T10:26:40,667 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml' 2026-02-14T10:26:40,668 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml' 2026-02-14T10:26:40,669 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml' 2026-02-14T10:26:40,670 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml' 2026-02-14T10:26:40,672 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml' 2026-02-14T10:26:40,673 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml' 2026-02-14T10:26:40,674 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml' 2026-02-14T10:26:40,675 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml' 2026-02-14T10:26:40,676 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml' 2026-02-14T10:26:40,678 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml' 2026-02-14T10:26:40,679 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml' 2026-02-14T10:26:40,680 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml' 2026-02-14T10:26:40,681 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml' 2026-02-14T10:26:40,682 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml' 2026-02-14T10:26:40,683 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,685 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,686 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml' 2026-02-14T10:26:40,687 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml' 2026-02-14T10:26:40,688 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml' 2026-02-14T10:26:40,689 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml' 2026-02-14T10:26:40,690 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml' 2026-02-14T10:26:40,691 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml' 2026-02-14T10:26:40,692 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml' 2026-02-14T10:26:40,694 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml' 2026-02-14T10:26:40,695 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml' 2026-02-14T10:26:40,696 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml' 2026-02-14T10:26:40,697 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml' 2026-02-14T10:26:40,698 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml' 2026-02-14T10:26:40,699 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml' 2026-02-14T10:26:40,700 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml' 2026-02-14T10:26:40,701 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml' 2026-02-14T10:26:40,703 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml' 2026-02-14T10:26:40,704 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml' 2026-02-14T10:26:40,705 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml' 2026-02-14T10:26:40,706 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml' 2026-02-14T10:26:40,707 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml' 2026-02-14T10:26:40,709 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml' 2026-02-14T10:26:40,710 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml' 2026-02-14T10:26:40,711 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml' 2026-02-14T10:26:40,712 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml' 2026-02-14T10:26:40,713 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml' 2026-02-14T10:26:40,715 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml' 2026-02-14T10:26:40,716 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml' 2026-02-14T10:26:40,717 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml' 2026-02-14T10:26:40,718 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml' 2026-02-14T10:26:40,719 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml' 2026-02-14T10:26:40,721 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml' 2026-02-14T10:26:40,722 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml' 2026-02-14T10:26:40,723 adding 'lm_eval/tasks/global_mmlu/full/fa/utils.py' 2026-02-14T10:26:40,726 adding 'lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml' 2026-02-14T10:26:40,728 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml' 2026-02-14T10:26:40,729 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml' 2026-02-14T10:26:40,730 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml' 2026-02-14T10:26:40,731 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml' 2026-02-14T10:26:40,732 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml' 2026-02-14T10:26:40,733 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml' 2026-02-14T10:26:40,734 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml' 2026-02-14T10:26:40,736 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml' 2026-02-14T10:26:40,737 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml' 2026-02-14T10:26:40,738 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml' 2026-02-14T10:26:40,739 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml' 2026-02-14T10:26:40,740 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml' 2026-02-14T10:26:40,742 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml' 2026-02-14T10:26:40,743 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml' 2026-02-14T10:26:40,744 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml' 2026-02-14T10:26:40,745 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml' 2026-02-14T10:26:40,746 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml' 2026-02-14T10:26:40,748 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml' 2026-02-14T10:26:40,749 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml' 2026-02-14T10:26:40,750 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml' 2026-02-14T10:26:40,751 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml' 2026-02-14T10:26:40,753 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml' 2026-02-14T10:26:40,754 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml' 2026-02-14T10:26:40,755 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml' 2026-02-14T10:26:40,756 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml' 2026-02-14T10:26:40,758 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml' 2026-02-14T10:26:40,759 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml' 2026-02-14T10:26:40,760 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml' 2026-02-14T10:26:40,761 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,763 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,764 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml' 2026-02-14T10:26:40,765 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml' 2026-02-14T10:26:40,767 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml' 2026-02-14T10:26:40,768 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml' 2026-02-14T10:26:40,769 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml' 2026-02-14T10:26:40,770 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml' 2026-02-14T10:26:40,772 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml' 2026-02-14T10:26:40,773 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml' 2026-02-14T10:26:40,774 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml' 2026-02-14T10:26:40,775 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml' 2026-02-14T10:26:40,776 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml' 2026-02-14T10:26:40,777 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml' 2026-02-14T10:26:40,779 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml' 2026-02-14T10:26:40,780 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml' 2026-02-14T10:26:40,781 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml' 2026-02-14T10:26:40,782 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml' 2026-02-14T10:26:40,783 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml' 2026-02-14T10:26:40,785 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml' 2026-02-14T10:26:40,786 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml' 2026-02-14T10:26:40,787 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml' 2026-02-14T10:26:40,788 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml' 2026-02-14T10:26:40,789 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml' 2026-02-14T10:26:40,790 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml' 2026-02-14T10:26:40,792 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml' 2026-02-14T10:26:40,793 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml' 2026-02-14T10:26:40,794 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml' 2026-02-14T10:26:40,795 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml' 2026-02-14T10:26:40,796 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml' 2026-02-14T10:26:40,798 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml' 2026-02-14T10:26:40,799 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml' 2026-02-14T10:26:40,800 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml' 2026-02-14T10:26:40,801 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml' 2026-02-14T10:26:40,803 adding 'lm_eval/tasks/global_mmlu/full/fil/utils.py' 2026-02-14T10:26:40,806 adding 'lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml' 2026-02-14T10:26:40,807 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml' 2026-02-14T10:26:40,808 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml' 2026-02-14T10:26:40,810 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml' 2026-02-14T10:26:40,811 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml' 2026-02-14T10:26:40,812 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml' 2026-02-14T10:26:40,813 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml' 2026-02-14T10:26:40,815 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml' 2026-02-14T10:26:40,816 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml' 2026-02-14T10:26:40,817 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml' 2026-02-14T10:26:40,819 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml' 2026-02-14T10:26:40,820 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml' 2026-02-14T10:26:40,821 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml' 2026-02-14T10:26:40,822 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml' 2026-02-14T10:26:40,824 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml' 2026-02-14T10:26:40,825 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml' 2026-02-14T10:26:40,826 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml' 2026-02-14T10:26:40,827 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml' 2026-02-14T10:26:40,829 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml' 2026-02-14T10:26:40,830 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml' 2026-02-14T10:26:40,831 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml' 2026-02-14T10:26:40,832 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml' 2026-02-14T10:26:40,833 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml' 2026-02-14T10:26:40,834 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml' 2026-02-14T10:26:40,836 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml' 2026-02-14T10:26:40,837 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml' 2026-02-14T10:26:40,838 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml' 2026-02-14T10:26:40,839 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml' 2026-02-14T10:26:40,841 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml' 2026-02-14T10:26:40,842 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,843 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,844 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml' 2026-02-14T10:26:40,846 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml' 2026-02-14T10:26:40,847 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml' 2026-02-14T10:26:40,848 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml' 2026-02-14T10:26:40,849 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml' 2026-02-14T10:26:40,851 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml' 2026-02-14T10:26:40,852 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml' 2026-02-14T10:26:40,854 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml' 2026-02-14T10:26:40,855 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml' 2026-02-14T10:26:40,856 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml' 2026-02-14T10:26:40,858 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml' 2026-02-14T10:26:40,859 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml' 2026-02-14T10:26:40,860 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml' 2026-02-14T10:26:40,861 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml' 2026-02-14T10:26:40,863 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml' 2026-02-14T10:26:40,864 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml' 2026-02-14T10:26:40,865 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml' 2026-02-14T10:26:40,866 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml' 2026-02-14T10:26:40,868 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml' 2026-02-14T10:26:40,869 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml' 2026-02-14T10:26:40,870 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml' 2026-02-14T10:26:40,871 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml' 2026-02-14T10:26:40,872 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml' 2026-02-14T10:26:40,874 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml' 2026-02-14T10:26:40,875 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml' 2026-02-14T10:26:40,876 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml' 2026-02-14T10:26:40,877 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml' 2026-02-14T10:26:40,879 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml' 2026-02-14T10:26:40,880 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml' 2026-02-14T10:26:40,881 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml' 2026-02-14T10:26:40,883 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml' 2026-02-14T10:26:40,884 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml' 2026-02-14T10:26:40,885 adding 'lm_eval/tasks/global_mmlu/full/fr/utils.py' 2026-02-14T10:26:40,889 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml' 2026-02-14T10:26:40,890 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml' 2026-02-14T10:26:40,891 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml' 2026-02-14T10:26:40,893 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml' 2026-02-14T10:26:40,894 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml' 2026-02-14T10:26:40,895 adding 'lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml' 2026-02-14T10:26:40,897 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml' 2026-02-14T10:26:40,898 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml' 2026-02-14T10:26:40,899 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml' 2026-02-14T10:26:40,900 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml' 2026-02-14T10:26:40,902 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml' 2026-02-14T10:26:40,903 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml' 2026-02-14T10:26:40,904 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml' 2026-02-14T10:26:40,906 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml' 2026-02-14T10:26:40,907 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml' 2026-02-14T10:26:40,908 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml' 2026-02-14T10:26:40,910 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml' 2026-02-14T10:26:40,911 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml' 2026-02-14T10:26:40,912 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml' 2026-02-14T10:26:40,913 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml' 2026-02-14T10:26:40,915 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml' 2026-02-14T10:26:40,916 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml' 2026-02-14T10:26:40,917 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml' 2026-02-14T10:26:40,918 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml' 2026-02-14T10:26:40,919 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml' 2026-02-14T10:26:40,921 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml' 2026-02-14T10:26:40,922 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml' 2026-02-14T10:26:40,923 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml' 2026-02-14T10:26:40,924 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml' 2026-02-14T10:26:40,925 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml' 2026-02-14T10:26:40,926 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml' 2026-02-14T10:26:40,928 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml' 2026-02-14T10:26:40,929 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml' 2026-02-14T10:26:40,930 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml' 2026-02-14T10:26:40,931 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml' 2026-02-14T10:26:40,932 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml' 2026-02-14T10:26:40,934 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml' 2026-02-14T10:26:40,935 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml' 2026-02-14T10:26:40,936 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml' 2026-02-14T10:26:40,937 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml' 2026-02-14T10:26:40,938 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml' 2026-02-14T10:26:40,940 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml' 2026-02-14T10:26:40,941 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml' 2026-02-14T10:26:40,942 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml' 2026-02-14T10:26:40,943 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml' 2026-02-14T10:26:40,944 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml' 2026-02-14T10:26:40,946 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml' 2026-02-14T10:26:40,947 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml' 2026-02-14T10:26:40,948 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml' 2026-02-14T10:26:40,949 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml' 2026-02-14T10:26:40,951 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml' 2026-02-14T10:26:40,952 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml' 2026-02-14T10:26:40,953 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml' 2026-02-14T10:26:40,955 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml' 2026-02-14T10:26:40,956 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml' 2026-02-14T10:26:40,957 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml' 2026-02-14T10:26:40,958 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml' 2026-02-14T10:26:40,960 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml' 2026-02-14T10:26:40,961 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml' 2026-02-14T10:26:40,962 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml' 2026-02-14T10:26:40,963 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml' 2026-02-14T10:26:40,964 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml' 2026-02-14T10:26:40,966 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml' 2026-02-14T10:26:40,967 adding 'lm_eval/tasks/global_mmlu/full/ha/utils.py' 2026-02-14T10:26:40,970 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml' 2026-02-14T10:26:40,971 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml' 2026-02-14T10:26:40,972 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml' 2026-02-14T10:26:40,974 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml' 2026-02-14T10:26:40,975 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml' 2026-02-14T10:26:40,976 adding 'lm_eval/tasks/global_mmlu/full/he/_he_template_yaml' 2026-02-14T10:26:40,977 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml' 2026-02-14T10:26:40,979 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml' 2026-02-14T10:26:40,980 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml' 2026-02-14T10:26:40,981 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml' 2026-02-14T10:26:40,982 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml' 2026-02-14T10:26:40,983 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml' 2026-02-14T10:26:40,984 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml' 2026-02-14T10:26:40,986 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml' 2026-02-14T10:26:40,987 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml' 2026-02-14T10:26:40,988 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml' 2026-02-14T10:26:40,989 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml' 2026-02-14T10:26:40,991 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml' 2026-02-14T10:26:40,992 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml' 2026-02-14T10:26:40,993 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml' 2026-02-14T10:26:40,994 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml' 2026-02-14T10:26:40,995 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml' 2026-02-14T10:26:40,997 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml' 2026-02-14T10:26:40,998 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml' 2026-02-14T10:26:40,999 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml' 2026-02-14T10:26:41,000 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml' 2026-02-14T10:26:41,002 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml' 2026-02-14T10:26:41,003 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml' 2026-02-14T10:26:41,004 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml' 2026-02-14T10:26:41,005 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,007 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,008 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml' 2026-02-14T10:26:41,009 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml' 2026-02-14T10:26:41,010 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml' 2026-02-14T10:26:41,012 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml' 2026-02-14T10:26:41,013 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml' 2026-02-14T10:26:41,014 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml' 2026-02-14T10:26:41,015 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml' 2026-02-14T10:26:41,016 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml' 2026-02-14T10:26:41,018 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml' 2026-02-14T10:26:41,019 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml' 2026-02-14T10:26:41,020 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml' 2026-02-14T10:26:41,021 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml' 2026-02-14T10:26:41,022 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml' 2026-02-14T10:26:41,024 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml' 2026-02-14T10:26:41,025 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml' 2026-02-14T10:26:41,026 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml' 2026-02-14T10:26:41,027 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml' 2026-02-14T10:26:41,028 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml' 2026-02-14T10:26:41,030 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml' 2026-02-14T10:26:41,031 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml' 2026-02-14T10:26:41,032 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml' 2026-02-14T10:26:41,033 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml' 2026-02-14T10:26:41,034 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml' 2026-02-14T10:26:41,036 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml' 2026-02-14T10:26:41,037 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml' 2026-02-14T10:26:41,038 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml' 2026-02-14T10:26:41,039 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml' 2026-02-14T10:26:41,041 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml' 2026-02-14T10:26:41,042 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml' 2026-02-14T10:26:41,043 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml' 2026-02-14T10:26:41,044 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml' 2026-02-14T10:26:41,046 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml' 2026-02-14T10:26:41,047 adding 'lm_eval/tasks/global_mmlu/full/he/utils.py' 2026-02-14T10:26:41,050 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml' 2026-02-14T10:26:41,051 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml' 2026-02-14T10:26:41,052 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml' 2026-02-14T10:26:41,054 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml' 2026-02-14T10:26:41,055 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml' 2026-02-14T10:26:41,057 adding 'lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml' 2026-02-14T10:26:41,058 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml' 2026-02-14T10:26:41,059 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml' 2026-02-14T10:26:41,061 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml' 2026-02-14T10:26:41,062 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml' 2026-02-14T10:26:41,063 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml' 2026-02-14T10:26:41,065 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml' 2026-02-14T10:26:41,066 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml' 2026-02-14T10:26:41,068 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml' 2026-02-14T10:26:41,070 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml' 2026-02-14T10:26:41,071 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml' 2026-02-14T10:26:41,073 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml' 2026-02-14T10:26:41,074 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml' 2026-02-14T10:26:41,076 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml' 2026-02-14T10:26:41,078 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml' 2026-02-14T10:26:41,079 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml' 2026-02-14T10:26:41,081 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml' 2026-02-14T10:26:41,082 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml' 2026-02-14T10:26:41,084 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml' 2026-02-14T10:26:41,086 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml' 2026-02-14T10:26:41,087 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml' 2026-02-14T10:26:41,089 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml' 2026-02-14T10:26:41,091 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml' 2026-02-14T10:26:41,092 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml' 2026-02-14T10:26:41,094 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,095 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,097 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml' 2026-02-14T10:26:41,099 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml' 2026-02-14T10:26:41,100 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml' 2026-02-14T10:26:41,102 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml' 2026-02-14T10:26:41,104 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml' 2026-02-14T10:26:41,105 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml' 2026-02-14T10:26:41,107 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml' 2026-02-14T10:26:41,109 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml' 2026-02-14T10:26:41,110 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml' 2026-02-14T10:26:41,112 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml' 2026-02-14T10:26:41,113 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml' 2026-02-14T10:26:41,115 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml' 2026-02-14T10:26:41,116 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml' 2026-02-14T10:26:41,118 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml' 2026-02-14T10:26:41,119 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml' 2026-02-14T10:26:41,121 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml' 2026-02-14T10:26:41,122 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml' 2026-02-14T10:26:41,123 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml' 2026-02-14T10:26:41,125 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml' 2026-02-14T10:26:41,126 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml' 2026-02-14T10:26:41,128 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml' 2026-02-14T10:26:41,129 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml' 2026-02-14T10:26:41,131 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml' 2026-02-14T10:26:41,132 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml' 2026-02-14T10:26:41,134 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml' 2026-02-14T10:26:41,135 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml' 2026-02-14T10:26:41,137 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml' 2026-02-14T10:26:41,138 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml' 2026-02-14T10:26:41,139 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml' 2026-02-14T10:26:41,141 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml' 2026-02-14T10:26:41,142 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml' 2026-02-14T10:26:41,144 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml' 2026-02-14T10:26:41,145 adding 'lm_eval/tasks/global_mmlu/full/hi/utils.py' 2026-02-14T10:26:41,149 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml' 2026-02-14T10:26:41,150 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml' 2026-02-14T10:26:41,152 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml' 2026-02-14T10:26:41,154 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml' 2026-02-14T10:26:41,155 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml' 2026-02-14T10:26:41,157 adding 'lm_eval/tasks/global_mmlu/full/id/_id_template_yaml' 2026-02-14T10:26:41,158 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml' 2026-02-14T10:26:41,160 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml' 2026-02-14T10:26:41,162 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml' 2026-02-14T10:26:41,163 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml' 2026-02-14T10:26:41,165 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml' 2026-02-14T10:26:41,167 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml' 2026-02-14T10:26:41,168 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml' 2026-02-14T10:26:41,170 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml' 2026-02-14T10:26:41,172 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml' 2026-02-14T10:26:41,173 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml' 2026-02-14T10:26:41,175 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml' 2026-02-14T10:26:41,176 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml' 2026-02-14T10:26:41,177 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml' 2026-02-14T10:26:41,178 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml' 2026-02-14T10:26:41,180 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml' 2026-02-14T10:26:41,181 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml' 2026-02-14T10:26:41,182 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml' 2026-02-14T10:26:41,183 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml' 2026-02-14T10:26:41,184 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml' 2026-02-14T10:26:41,186 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml' 2026-02-14T10:26:41,187 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml' 2026-02-14T10:26:41,188 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml' 2026-02-14T10:26:41,189 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml' 2026-02-14T10:26:41,190 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,192 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,193 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml' 2026-02-14T10:26:41,194 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml' 2026-02-14T10:26:41,195 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml' 2026-02-14T10:26:41,197 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml' 2026-02-14T10:26:41,198 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml' 2026-02-14T10:26:41,199 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml' 2026-02-14T10:26:41,200 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml' 2026-02-14T10:26:41,201 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml' 2026-02-14T10:26:41,203 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml' 2026-02-14T10:26:41,204 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml' 2026-02-14T10:26:41,205 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml' 2026-02-14T10:26:41,206 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml' 2026-02-14T10:26:41,207 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml' 2026-02-14T10:26:41,209 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml' 2026-02-14T10:26:41,210 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml' 2026-02-14T10:26:41,211 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml' 2026-02-14T10:26:41,212 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml' 2026-02-14T10:26:41,214 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml' 2026-02-14T10:26:41,215 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml' 2026-02-14T10:26:41,216 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml' 2026-02-14T10:26:41,217 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml' 2026-02-14T10:26:41,218 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml' 2026-02-14T10:26:41,220 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml' 2026-02-14T10:26:41,221 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml' 2026-02-14T10:26:41,222 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml' 2026-02-14T10:26:41,223 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml' 2026-02-14T10:26:41,224 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml' 2026-02-14T10:26:41,225 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml' 2026-02-14T10:26:41,226 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml' 2026-02-14T10:26:41,228 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml' 2026-02-14T10:26:41,229 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml' 2026-02-14T10:26:41,230 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml' 2026-02-14T10:26:41,231 adding 'lm_eval/tasks/global_mmlu/full/id/utils.py' 2026-02-14T10:26:41,234 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml' 2026-02-14T10:26:41,236 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml' 2026-02-14T10:26:41,237 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml' 2026-02-14T10:26:41,238 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml' 2026-02-14T10:26:41,239 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml' 2026-02-14T10:26:41,240 adding 'lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml' 2026-02-14T10:26:41,242 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml' 2026-02-14T10:26:41,243 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml' 2026-02-14T10:26:41,244 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml' 2026-02-14T10:26:41,245 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml' 2026-02-14T10:26:41,246 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml' 2026-02-14T10:26:41,248 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml' 2026-02-14T10:26:41,249 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml' 2026-02-14T10:26:41,250 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml' 2026-02-14T10:26:41,251 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml' 2026-02-14T10:26:41,252 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml' 2026-02-14T10:26:41,254 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml' 2026-02-14T10:26:41,255 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml' 2026-02-14T10:26:41,256 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml' 2026-02-14T10:26:41,257 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml' 2026-02-14T10:26:41,258 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml' 2026-02-14T10:26:41,260 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml' 2026-02-14T10:26:41,261 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml' 2026-02-14T10:26:41,262 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml' 2026-02-14T10:26:41,263 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml' 2026-02-14T10:26:41,264 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml' 2026-02-14T10:26:41,265 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml' 2026-02-14T10:26:41,267 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml' 2026-02-14T10:26:41,268 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml' 2026-02-14T10:26:41,269 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,270 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,271 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml' 2026-02-14T10:26:41,272 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml' 2026-02-14T10:26:41,274 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml' 2026-02-14T10:26:41,275 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml' 2026-02-14T10:26:41,276 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml' 2026-02-14T10:26:41,277 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml' 2026-02-14T10:26:41,278 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml' 2026-02-14T10:26:41,280 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml' 2026-02-14T10:26:41,281 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml' 2026-02-14T10:26:41,282 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml' 2026-02-14T10:26:41,283 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml' 2026-02-14T10:26:41,284 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml' 2026-02-14T10:26:41,285 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml' 2026-02-14T10:26:41,287 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml' 2026-02-14T10:26:41,288 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml' 2026-02-14T10:26:41,289 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml' 2026-02-14T10:26:41,290 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml' 2026-02-14T10:26:41,291 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml' 2026-02-14T10:26:41,293 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml' 2026-02-14T10:26:41,294 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml' 2026-02-14T10:26:41,295 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml' 2026-02-14T10:26:41,296 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml' 2026-02-14T10:26:41,297 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml' 2026-02-14T10:26:41,298 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml' 2026-02-14T10:26:41,300 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml' 2026-02-14T10:26:41,301 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml' 2026-02-14T10:26:41,302 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml' 2026-02-14T10:26:41,303 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml' 2026-02-14T10:26:41,305 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml' 2026-02-14T10:26:41,306 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml' 2026-02-14T10:26:41,307 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml' 2026-02-14T10:26:41,308 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml' 2026-02-14T10:26:41,310 adding 'lm_eval/tasks/global_mmlu/full/ig/utils.py' 2026-02-14T10:26:41,313 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml' 2026-02-14T10:26:41,314 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml' 2026-02-14T10:26:41,315 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml' 2026-02-14T10:26:41,316 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml' 2026-02-14T10:26:41,317 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml' 2026-02-14T10:26:41,318 adding 'lm_eval/tasks/global_mmlu/full/it/_it_template_yaml' 2026-02-14T10:26:41,320 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml' 2026-02-14T10:26:41,321 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml' 2026-02-14T10:26:41,322 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml' 2026-02-14T10:26:41,323 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml' 2026-02-14T10:26:41,324 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml' 2026-02-14T10:26:41,325 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml' 2026-02-14T10:26:41,326 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml' 2026-02-14T10:26:41,327 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml' 2026-02-14T10:26:41,329 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml' 2026-02-14T10:26:41,330 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml' 2026-02-14T10:26:41,331 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml' 2026-02-14T10:26:41,332 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml' 2026-02-14T10:26:41,333 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml' 2026-02-14T10:26:41,334 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml' 2026-02-14T10:26:41,336 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml' 2026-02-14T10:26:41,337 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml' 2026-02-14T10:26:41,338 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml' 2026-02-14T10:26:41,339 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml' 2026-02-14T10:26:41,340 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml' 2026-02-14T10:26:41,342 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml' 2026-02-14T10:26:41,343 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml' 2026-02-14T10:26:41,344 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml' 2026-02-14T10:26:41,345 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml' 2026-02-14T10:26:41,346 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,348 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,349 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml' 2026-02-14T10:26:41,350 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml' 2026-02-14T10:26:41,351 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml' 2026-02-14T10:26:41,352 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml' 2026-02-14T10:26:41,353 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml' 2026-02-14T10:26:41,354 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml' 2026-02-14T10:26:41,355 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml' 2026-02-14T10:26:41,356 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml' 2026-02-14T10:26:41,358 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml' 2026-02-14T10:26:41,359 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml' 2026-02-14T10:26:41,360 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml' 2026-02-14T10:26:41,361 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml' 2026-02-14T10:26:41,362 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml' 2026-02-14T10:26:41,363 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml' 2026-02-14T10:26:41,364 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml' 2026-02-14T10:26:41,365 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml' 2026-02-14T10:26:41,367 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml' 2026-02-14T10:26:41,368 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml' 2026-02-14T10:26:41,369 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml' 2026-02-14T10:26:41,370 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml' 2026-02-14T10:26:41,371 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml' 2026-02-14T10:26:41,372 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml' 2026-02-14T10:26:41,373 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml' 2026-02-14T10:26:41,375 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml' 2026-02-14T10:26:41,376 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml' 2026-02-14T10:26:41,377 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml' 2026-02-14T10:26:41,378 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml' 2026-02-14T10:26:41,379 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml' 2026-02-14T10:26:41,380 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml' 2026-02-14T10:26:41,381 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml' 2026-02-14T10:26:41,383 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml' 2026-02-14T10:26:41,384 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml' 2026-02-14T10:26:41,385 adding 'lm_eval/tasks/global_mmlu/full/it/utils.py' 2026-02-14T10:26:41,388 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml' 2026-02-14T10:26:41,389 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml' 2026-02-14T10:26:41,391 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml' 2026-02-14T10:26:41,392 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml' 2026-02-14T10:26:41,393 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml' 2026-02-14T10:26:41,394 adding 'lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml' 2026-02-14T10:26:41,395 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml' 2026-02-14T10:26:41,397 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml' 2026-02-14T10:26:41,398 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml' 2026-02-14T10:26:41,399 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml' 2026-02-14T10:26:41,400 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml' 2026-02-14T10:26:41,401 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml' 2026-02-14T10:26:41,402 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml' 2026-02-14T10:26:41,403 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml' 2026-02-14T10:26:41,404 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml' 2026-02-14T10:26:41,405 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml' 2026-02-14T10:26:41,407 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml' 2026-02-14T10:26:41,408 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml' 2026-02-14T10:26:41,409 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml' 2026-02-14T10:26:41,410 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml' 2026-02-14T10:26:41,411 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml' 2026-02-14T10:26:41,412 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml' 2026-02-14T10:26:41,413 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml' 2026-02-14T10:26:41,415 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml' 2026-02-14T10:26:41,416 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml' 2026-02-14T10:26:41,417 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml' 2026-02-14T10:26:41,418 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml' 2026-02-14T10:26:41,419 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml' 2026-02-14T10:26:41,420 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml' 2026-02-14T10:26:41,422 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,423 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,424 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml' 2026-02-14T10:26:41,425 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml' 2026-02-14T10:26:41,426 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml' 2026-02-14T10:26:41,428 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml' 2026-02-14T10:26:41,429 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml' 2026-02-14T10:26:41,430 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml' 2026-02-14T10:26:41,431 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml' 2026-02-14T10:26:41,433 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml' 2026-02-14T10:26:41,434 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml' 2026-02-14T10:26:41,435 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml' 2026-02-14T10:26:41,436 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml' 2026-02-14T10:26:41,438 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml' 2026-02-14T10:26:41,439 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml' 2026-02-14T10:26:41,440 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml' 2026-02-14T10:26:41,441 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml' 2026-02-14T10:26:41,442 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml' 2026-02-14T10:26:41,443 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml' 2026-02-14T10:26:41,444 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml' 2026-02-14T10:26:41,445 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml' 2026-02-14T10:26:41,446 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml' 2026-02-14T10:26:41,447 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml' 2026-02-14T10:26:41,449 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml' 2026-02-14T10:26:41,450 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml' 2026-02-14T10:26:41,451 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml' 2026-02-14T10:26:41,452 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml' 2026-02-14T10:26:41,453 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml' 2026-02-14T10:26:41,454 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml' 2026-02-14T10:26:41,456 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml' 2026-02-14T10:26:41,457 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml' 2026-02-14T10:26:41,458 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml' 2026-02-14T10:26:41,459 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml' 2026-02-14T10:26:41,460 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml' 2026-02-14T10:26:41,461 adding 'lm_eval/tasks/global_mmlu/full/ja/utils.py' 2026-02-14T10:26:41,465 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml' 2026-02-14T10:26:41,466 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml' 2026-02-14T10:26:41,467 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml' 2026-02-14T10:26:41,468 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml' 2026-02-14T10:26:41,470 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml' 2026-02-14T10:26:41,471 adding 'lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml' 2026-02-14T10:26:41,472 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml' 2026-02-14T10:26:41,473 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml' 2026-02-14T10:26:41,474 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml' 2026-02-14T10:26:41,476 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml' 2026-02-14T10:26:41,477 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml' 2026-02-14T10:26:41,478 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml' 2026-02-14T10:26:41,479 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml' 2026-02-14T10:26:41,480 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml' 2026-02-14T10:26:41,481 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml' 2026-02-14T10:26:41,483 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml' 2026-02-14T10:26:41,484 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml' 2026-02-14T10:26:41,485 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml' 2026-02-14T10:26:41,486 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml' 2026-02-14T10:26:41,487 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml' 2026-02-14T10:26:41,488 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml' 2026-02-14T10:26:41,489 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml' 2026-02-14T10:26:41,490 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml' 2026-02-14T10:26:41,492 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml' 2026-02-14T10:26:41,493 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml' 2026-02-14T10:26:41,494 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml' 2026-02-14T10:26:41,495 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml' 2026-02-14T10:26:41,496 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml' 2026-02-14T10:26:41,498 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml' 2026-02-14T10:26:41,499 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,500 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,501 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml' 2026-02-14T10:26:41,502 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml' 2026-02-14T10:26:41,503 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml' 2026-02-14T10:26:41,504 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml' 2026-02-14T10:26:41,506 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml' 2026-02-14T10:26:41,507 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml' 2026-02-14T10:26:41,508 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml' 2026-02-14T10:26:41,509 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml' 2026-02-14T10:26:41,510 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml' 2026-02-14T10:26:41,512 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml' 2026-02-14T10:26:41,513 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml' 2026-02-14T10:26:41,514 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml' 2026-02-14T10:26:41,515 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml' 2026-02-14T10:26:41,516 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml' 2026-02-14T10:26:41,518 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml' 2026-02-14T10:26:41,519 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml' 2026-02-14T10:26:41,520 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml' 2026-02-14T10:26:41,521 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml' 2026-02-14T10:26:41,522 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml' 2026-02-14T10:26:41,524 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml' 2026-02-14T10:26:41,525 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml' 2026-02-14T10:26:41,526 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml' 2026-02-14T10:26:41,527 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml' 2026-02-14T10:26:41,528 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml' 2026-02-14T10:26:41,529 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml' 2026-02-14T10:26:41,530 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml' 2026-02-14T10:26:41,531 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml' 2026-02-14T10:26:41,533 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml' 2026-02-14T10:26:41,534 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml' 2026-02-14T10:26:41,535 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml' 2026-02-14T10:26:41,536 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml' 2026-02-14T10:26:41,537 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml' 2026-02-14T10:26:41,538 adding 'lm_eval/tasks/global_mmlu/full/ko/utils.py' 2026-02-14T10:26:41,541 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml' 2026-02-14T10:26:41,543 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml' 2026-02-14T10:26:41,544 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml' 2026-02-14T10:26:41,545 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml' 2026-02-14T10:26:41,546 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml' 2026-02-14T10:26:41,547 adding 'lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml' 2026-02-14T10:26:41,548 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml' 2026-02-14T10:26:41,549 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml' 2026-02-14T10:26:41,550 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml' 2026-02-14T10:26:41,552 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml' 2026-02-14T10:26:41,553 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml' 2026-02-14T10:26:41,554 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml' 2026-02-14T10:26:41,555 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml' 2026-02-14T10:26:41,556 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml' 2026-02-14T10:26:41,558 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml' 2026-02-14T10:26:41,559 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml' 2026-02-14T10:26:41,560 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml' 2026-02-14T10:26:41,562 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml' 2026-02-14T10:26:41,564 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml' 2026-02-14T10:26:41,565 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml' 2026-02-14T10:26:41,567 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml' 2026-02-14T10:26:41,570 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml' 2026-02-14T10:26:41,571 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml' 2026-02-14T10:26:41,573 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml' 2026-02-14T10:26:41,574 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml' 2026-02-14T10:26:41,575 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml' 2026-02-14T10:26:41,577 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml' 2026-02-14T10:26:41,578 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml' 2026-02-14T10:26:41,580 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml' 2026-02-14T10:26:41,581 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,583 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,584 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml' 2026-02-14T10:26:41,585 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml' 2026-02-14T10:26:41,586 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml' 2026-02-14T10:26:41,587 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml' 2026-02-14T10:26:41,589 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml' 2026-02-14T10:26:41,590 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml' 2026-02-14T10:26:41,591 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml' 2026-02-14T10:26:41,592 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml' 2026-02-14T10:26:41,593 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml' 2026-02-14T10:26:41,594 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml' 2026-02-14T10:26:41,595 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml' 2026-02-14T10:26:41,597 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml' 2026-02-14T10:26:41,598 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml' 2026-02-14T10:26:41,599 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml' 2026-02-14T10:26:41,601 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml' 2026-02-14T10:26:41,602 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml' 2026-02-14T10:26:41,603 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml' 2026-02-14T10:26:41,605 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml' 2026-02-14T10:26:41,606 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml' 2026-02-14T10:26:41,607 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml' 2026-02-14T10:26:41,609 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml' 2026-02-14T10:26:41,610 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml' 2026-02-14T10:26:41,611 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml' 2026-02-14T10:26:41,613 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml' 2026-02-14T10:26:41,614 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml' 2026-02-14T10:26:41,616 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml' 2026-02-14T10:26:41,617 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml' 2026-02-14T10:26:41,619 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml' 2026-02-14T10:26:41,620 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml' 2026-02-14T10:26:41,621 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml' 2026-02-14T10:26:41,622 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml' 2026-02-14T10:26:41,624 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml' 2026-02-14T10:26:41,626 adding 'lm_eval/tasks/global_mmlu/full/ky/utils.py' 2026-02-14T10:26:41,629 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml' 2026-02-14T10:26:41,631 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml' 2026-02-14T10:26:41,632 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml' 2026-02-14T10:26:41,633 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml' 2026-02-14T10:26:41,634 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml' 2026-02-14T10:26:41,636 adding 'lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml' 2026-02-14T10:26:41,637 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml' 2026-02-14T10:26:41,639 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml' 2026-02-14T10:26:41,640 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml' 2026-02-14T10:26:41,641 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml' 2026-02-14T10:26:41,642 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml' 2026-02-14T10:26:41,643 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml' 2026-02-14T10:26:41,644 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml' 2026-02-14T10:26:41,646 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml' 2026-02-14T10:26:41,647 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml' 2026-02-14T10:26:41,648 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml' 2026-02-14T10:26:41,649 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml' 2026-02-14T10:26:41,650 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml' 2026-02-14T10:26:41,651 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml' 2026-02-14T10:26:41,653 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml' 2026-02-14T10:26:41,654 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml' 2026-02-14T10:26:41,655 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml' 2026-02-14T10:26:41,656 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml' 2026-02-14T10:26:41,658 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml' 2026-02-14T10:26:41,659 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml' 2026-02-14T10:26:41,660 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml' 2026-02-14T10:26:41,661 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml' 2026-02-14T10:26:41,663 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml' 2026-02-14T10:26:41,664 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml' 2026-02-14T10:26:41,665 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,666 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,668 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml' 2026-02-14T10:26:41,669 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml' 2026-02-14T10:26:41,670 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml' 2026-02-14T10:26:41,671 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml' 2026-02-14T10:26:41,672 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml' 2026-02-14T10:26:41,674 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml' 2026-02-14T10:26:41,675 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml' 2026-02-14T10:26:41,676 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml' 2026-02-14T10:26:41,677 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml' 2026-02-14T10:26:41,678 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml' 2026-02-14T10:26:41,679 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml' 2026-02-14T10:26:41,680 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml' 2026-02-14T10:26:41,681 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml' 2026-02-14T10:26:41,682 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml' 2026-02-14T10:26:41,683 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml' 2026-02-14T10:26:41,685 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml' 2026-02-14T10:26:41,686 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml' 2026-02-14T10:26:41,687 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml' 2026-02-14T10:26:41,688 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml' 2026-02-14T10:26:41,689 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml' 2026-02-14T10:26:41,690 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml' 2026-02-14T10:26:41,693 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml' 2026-02-14T10:26:41,695 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml' 2026-02-14T10:26:41,696 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml' 2026-02-14T10:26:41,697 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml' 2026-02-14T10:26:41,698 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml' 2026-02-14T10:26:41,699 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml' 2026-02-14T10:26:41,700 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml' 2026-02-14T10:26:41,701 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml' 2026-02-14T10:26:41,703 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml' 2026-02-14T10:26:41,704 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml' 2026-02-14T10:26:41,705 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml' 2026-02-14T10:26:41,706 adding 'lm_eval/tasks/global_mmlu/full/lt/utils.py' 2026-02-14T10:26:41,710 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml' 2026-02-14T10:26:41,711 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml' 2026-02-14T10:26:41,712 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml' 2026-02-14T10:26:41,714 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml' 2026-02-14T10:26:41,715 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml' 2026-02-14T10:26:41,716 adding 'lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml' 2026-02-14T10:26:41,717 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml' 2026-02-14T10:26:41,718 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml' 2026-02-14T10:26:41,720 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml' 2026-02-14T10:26:41,721 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml' 2026-02-14T10:26:41,722 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml' 2026-02-14T10:26:41,723 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml' 2026-02-14T10:26:41,724 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml' 2026-02-14T10:26:41,725 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml' 2026-02-14T10:26:41,726 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml' 2026-02-14T10:26:41,727 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml' 2026-02-14T10:26:41,729 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml' 2026-02-14T10:26:41,730 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml' 2026-02-14T10:26:41,731 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml' 2026-02-14T10:26:41,732 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml' 2026-02-14T10:26:41,733 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml' 2026-02-14T10:26:41,734 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml' 2026-02-14T10:26:41,735 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml' 2026-02-14T10:26:41,737 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml' 2026-02-14T10:26:41,738 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml' 2026-02-14T10:26:41,739 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml' 2026-02-14T10:26:41,740 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml' 2026-02-14T10:26:41,741 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml' 2026-02-14T10:26:41,743 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml' 2026-02-14T10:26:41,744 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,745 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,746 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml' 2026-02-14T10:26:41,747 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml' 2026-02-14T10:26:41,749 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml' 2026-02-14T10:26:41,750 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml' 2026-02-14T10:26:41,751 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml' 2026-02-14T10:26:41,753 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml' 2026-02-14T10:26:41,754 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml' 2026-02-14T10:26:41,755 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml' 2026-02-14T10:26:41,756 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml' 2026-02-14T10:26:41,757 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml' 2026-02-14T10:26:41,759 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml' 2026-02-14T10:26:41,760 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml' 2026-02-14T10:26:41,761 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml' 2026-02-14T10:26:41,762 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml' 2026-02-14T10:26:41,763 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml' 2026-02-14T10:26:41,765 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml' 2026-02-14T10:26:41,766 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml' 2026-02-14T10:26:41,767 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml' 2026-02-14T10:26:41,768 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml' 2026-02-14T10:26:41,769 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml' 2026-02-14T10:26:41,771 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml' 2026-02-14T10:26:41,772 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml' 2026-02-14T10:26:41,773 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml' 2026-02-14T10:26:41,775 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml' 2026-02-14T10:26:41,776 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml' 2026-02-14T10:26:41,777 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml' 2026-02-14T10:26:41,778 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml' 2026-02-14T10:26:41,779 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml' 2026-02-14T10:26:41,780 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml' 2026-02-14T10:26:41,781 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml' 2026-02-14T10:26:41,783 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml' 2026-02-14T10:26:41,784 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml' 2026-02-14T10:26:41,785 adding 'lm_eval/tasks/global_mmlu/full/mg/utils.py' 2026-02-14T10:26:41,788 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml' 2026-02-14T10:26:41,789 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml' 2026-02-14T10:26:41,790 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml' 2026-02-14T10:26:41,792 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml' 2026-02-14T10:26:41,793 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml' 2026-02-14T10:26:41,794 adding 'lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml' 2026-02-14T10:26:41,795 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml' 2026-02-14T10:26:41,796 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml' 2026-02-14T10:26:41,798 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml' 2026-02-14T10:26:41,799 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml' 2026-02-14T10:26:41,800 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml' 2026-02-14T10:26:41,801 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml' 2026-02-14T10:26:41,802 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml' 2026-02-14T10:26:41,803 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml' 2026-02-14T10:26:41,804 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml' 2026-02-14T10:26:41,806 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml' 2026-02-14T10:26:41,807 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml' 2026-02-14T10:26:41,808 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml' 2026-02-14T10:26:41,809 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml' 2026-02-14T10:26:41,810 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml' 2026-02-14T10:26:41,812 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml' 2026-02-14T10:26:41,813 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml' 2026-02-14T10:26:41,814 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml' 2026-02-14T10:26:41,815 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml' 2026-02-14T10:26:41,816 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml' 2026-02-14T10:26:41,817 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml' 2026-02-14T10:26:41,818 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml' 2026-02-14T10:26:41,820 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml' 2026-02-14T10:26:41,821 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml' 2026-02-14T10:26:41,822 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,823 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,824 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml' 2026-02-14T10:26:41,826 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml' 2026-02-14T10:26:41,827 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml' 2026-02-14T10:26:41,828 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml' 2026-02-14T10:26:41,830 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml' 2026-02-14T10:26:41,832 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml' 2026-02-14T10:26:41,833 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml' 2026-02-14T10:26:41,835 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml' 2026-02-14T10:26:41,836 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml' 2026-02-14T10:26:41,837 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml' 2026-02-14T10:26:41,839 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml' 2026-02-14T10:26:41,840 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml' 2026-02-14T10:26:41,841 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml' 2026-02-14T10:26:41,842 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml' 2026-02-14T10:26:41,844 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml' 2026-02-14T10:26:41,845 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml' 2026-02-14T10:26:41,846 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml' 2026-02-14T10:26:41,847 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml' 2026-02-14T10:26:41,848 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml' 2026-02-14T10:26:41,849 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml' 2026-02-14T10:26:41,851 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml' 2026-02-14T10:26:41,852 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml' 2026-02-14T10:26:41,853 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml' 2026-02-14T10:26:41,854 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml' 2026-02-14T10:26:41,856 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml' 2026-02-14T10:26:41,857 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml' 2026-02-14T10:26:41,858 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml' 2026-02-14T10:26:41,859 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml' 2026-02-14T10:26:41,860 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml' 2026-02-14T10:26:41,861 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml' 2026-02-14T10:26:41,862 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml' 2026-02-14T10:26:41,864 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml' 2026-02-14T10:26:41,865 adding 'lm_eval/tasks/global_mmlu/full/ms/utils.py' 2026-02-14T10:26:41,868 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml' 2026-02-14T10:26:41,869 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml' 2026-02-14T10:26:41,870 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml' 2026-02-14T10:26:41,871 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml' 2026-02-14T10:26:41,873 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml' 2026-02-14T10:26:41,874 adding 'lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml' 2026-02-14T10:26:41,875 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml' 2026-02-14T10:26:41,876 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml' 2026-02-14T10:26:41,877 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml' 2026-02-14T10:26:41,878 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml' 2026-02-14T10:26:41,879 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml' 2026-02-14T10:26:41,881 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml' 2026-02-14T10:26:41,882 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml' 2026-02-14T10:26:41,883 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml' 2026-02-14T10:26:41,884 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml' 2026-02-14T10:26:41,885 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml' 2026-02-14T10:26:41,886 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml' 2026-02-14T10:26:41,887 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml' 2026-02-14T10:26:41,889 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml' 2026-02-14T10:26:41,890 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml' 2026-02-14T10:26:41,891 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml' 2026-02-14T10:26:41,892 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml' 2026-02-14T10:26:41,893 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml' 2026-02-14T10:26:41,894 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml' 2026-02-14T10:26:41,896 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml' 2026-02-14T10:26:41,897 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml' 2026-02-14T10:26:41,898 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml' 2026-02-14T10:26:41,899 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml' 2026-02-14T10:26:41,900 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml' 2026-02-14T10:26:41,902 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,903 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,904 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml' 2026-02-14T10:26:41,905 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml' 2026-02-14T10:26:41,907 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml' 2026-02-14T10:26:41,908 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml' 2026-02-14T10:26:41,909 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml' 2026-02-14T10:26:41,910 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml' 2026-02-14T10:26:41,911 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml' 2026-02-14T10:26:41,912 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml' 2026-02-14T10:26:41,914 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml' 2026-02-14T10:26:41,915 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml' 2026-02-14T10:26:41,916 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml' 2026-02-14T10:26:41,917 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml' 2026-02-14T10:26:41,918 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml' 2026-02-14T10:26:41,919 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml' 2026-02-14T10:26:41,921 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml' 2026-02-14T10:26:41,922 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml' 2026-02-14T10:26:41,923 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml' 2026-02-14T10:26:41,924 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml' 2026-02-14T10:26:41,925 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml' 2026-02-14T10:26:41,926 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml' 2026-02-14T10:26:41,927 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml' 2026-02-14T10:26:41,928 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml' 2026-02-14T10:26:41,930 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml' 2026-02-14T10:26:41,931 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml' 2026-02-14T10:26:41,932 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml' 2026-02-14T10:26:41,933 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml' 2026-02-14T10:26:41,934 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml' 2026-02-14T10:26:41,936 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml' 2026-02-14T10:26:41,937 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml' 2026-02-14T10:26:41,938 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml' 2026-02-14T10:26:41,939 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml' 2026-02-14T10:26:41,940 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml' 2026-02-14T10:26:41,942 adding 'lm_eval/tasks/global_mmlu/full/ne/utils.py' 2026-02-14T10:26:41,945 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml' 2026-02-14T10:26:41,946 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml' 2026-02-14T10:26:41,947 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml' 2026-02-14T10:26:41,948 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml' 2026-02-14T10:26:41,949 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml' 2026-02-14T10:26:41,950 adding 'lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml' 2026-02-14T10:26:41,952 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml' 2026-02-14T10:26:41,953 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml' 2026-02-14T10:26:41,954 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml' 2026-02-14T10:26:41,955 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml' 2026-02-14T10:26:41,956 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml' 2026-02-14T10:26:41,958 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml' 2026-02-14T10:26:41,959 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml' 2026-02-14T10:26:41,960 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml' 2026-02-14T10:26:41,961 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml' 2026-02-14T10:26:41,962 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml' 2026-02-14T10:26:41,964 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml' 2026-02-14T10:26:41,965 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml' 2026-02-14T10:26:41,966 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml' 2026-02-14T10:26:41,967 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml' 2026-02-14T10:26:41,968 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml' 2026-02-14T10:26:41,969 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml' 2026-02-14T10:26:41,971 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml' 2026-02-14T10:26:41,972 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml' 2026-02-14T10:26:41,973 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml' 2026-02-14T10:26:41,974 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml' 2026-02-14T10:26:41,975 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml' 2026-02-14T10:26:41,977 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml' 2026-02-14T10:26:41,978 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml' 2026-02-14T10:26:41,979 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml' 2026-02-14T10:26:41,980 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml' 2026-02-14T10:26:41,981 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml' 2026-02-14T10:26:41,982 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml' 2026-02-14T10:26:41,983 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml' 2026-02-14T10:26:41,985 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml' 2026-02-14T10:26:41,986 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml' 2026-02-14T10:26:41,987 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml' 2026-02-14T10:26:41,988 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml' 2026-02-14T10:26:41,989 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml' 2026-02-14T10:26:41,991 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml' 2026-02-14T10:26:41,992 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml' 2026-02-14T10:26:41,993 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml' 2026-02-14T10:26:41,994 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml' 2026-02-14T10:26:41,995 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml' 2026-02-14T10:26:41,997 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml' 2026-02-14T10:26:41,998 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml' 2026-02-14T10:26:41,999 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml' 2026-02-14T10:26:42,000 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml' 2026-02-14T10:26:42,002 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml' 2026-02-14T10:26:42,003 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml' 2026-02-14T10:26:42,004 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml' 2026-02-14T10:26:42,005 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml' 2026-02-14T10:26:42,006 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml' 2026-02-14T10:26:42,007 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml' 2026-02-14T10:26:42,009 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml' 2026-02-14T10:26:42,010 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml' 2026-02-14T10:26:42,011 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml' 2026-02-14T10:26:42,012 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml' 2026-02-14T10:26:42,014 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml' 2026-02-14T10:26:42,015 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml' 2026-02-14T10:26:42,016 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml' 2026-02-14T10:26:42,017 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml' 2026-02-14T10:26:42,018 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml' 2026-02-14T10:26:42,020 adding 'lm_eval/tasks/global_mmlu/full/nl/utils.py' 2026-02-14T10:26:42,023 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml' 2026-02-14T10:26:42,024 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml' 2026-02-14T10:26:42,025 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml' 2026-02-14T10:26:42,026 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml' 2026-02-14T10:26:42,027 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml' 2026-02-14T10:26:42,029 adding 'lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml' 2026-02-14T10:26:42,030 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml' 2026-02-14T10:26:42,031 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml' 2026-02-14T10:26:42,032 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml' 2026-02-14T10:26:42,033 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml' 2026-02-14T10:26:42,034 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml' 2026-02-14T10:26:42,036 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml' 2026-02-14T10:26:42,037 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml' 2026-02-14T10:26:42,038 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml' 2026-02-14T10:26:42,039 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml' 2026-02-14T10:26:42,041 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml' 2026-02-14T10:26:42,042 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml' 2026-02-14T10:26:42,043 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml' 2026-02-14T10:26:42,044 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml' 2026-02-14T10:26:42,045 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml' 2026-02-14T10:26:42,046 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml' 2026-02-14T10:26:42,047 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml' 2026-02-14T10:26:42,048 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml' 2026-02-14T10:26:42,050 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml' 2026-02-14T10:26:42,051 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml' 2026-02-14T10:26:42,052 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml' 2026-02-14T10:26:42,053 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml' 2026-02-14T10:26:42,054 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml' 2026-02-14T10:26:42,055 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml' 2026-02-14T10:26:42,057 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,058 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,059 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml' 2026-02-14T10:26:42,060 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml' 2026-02-14T10:26:42,061 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml' 2026-02-14T10:26:42,062 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml' 2026-02-14T10:26:42,064 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml' 2026-02-14T10:26:42,065 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml' 2026-02-14T10:26:42,066 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml' 2026-02-14T10:26:42,067 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml' 2026-02-14T10:26:42,068 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml' 2026-02-14T10:26:42,069 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml' 2026-02-14T10:26:42,071 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml' 2026-02-14T10:26:42,072 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml' 2026-02-14T10:26:42,073 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml' 2026-02-14T10:26:42,074 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml' 2026-02-14T10:26:42,075 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml' 2026-02-14T10:26:42,077 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml' 2026-02-14T10:26:42,078 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml' 2026-02-14T10:26:42,079 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml' 2026-02-14T10:26:42,080 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml' 2026-02-14T10:26:42,081 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml' 2026-02-14T10:26:42,082 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml' 2026-02-14T10:26:42,084 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml' 2026-02-14T10:26:42,085 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml' 2026-02-14T10:26:42,086 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml' 2026-02-14T10:26:42,087 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml' 2026-02-14T10:26:42,088 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml' 2026-02-14T10:26:42,089 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml' 2026-02-14T10:26:42,090 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml' 2026-02-14T10:26:42,091 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml' 2026-02-14T10:26:42,093 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml' 2026-02-14T10:26:42,094 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml' 2026-02-14T10:26:42,095 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml' 2026-02-14T10:26:42,096 adding 'lm_eval/tasks/global_mmlu/full/ny/utils.py' 2026-02-14T10:26:42,099 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml' 2026-02-14T10:26:42,100 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml' 2026-02-14T10:26:42,102 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml' 2026-02-14T10:26:42,103 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml' 2026-02-14T10:26:42,104 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml' 2026-02-14T10:26:42,105 adding 'lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml' 2026-02-14T10:26:42,106 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml' 2026-02-14T10:26:42,107 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml' 2026-02-14T10:26:42,109 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml' 2026-02-14T10:26:42,110 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml' 2026-02-14T10:26:42,111 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml' 2026-02-14T10:26:42,113 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml' 2026-02-14T10:26:42,114 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml' 2026-02-14T10:26:42,115 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml' 2026-02-14T10:26:42,117 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml' 2026-02-14T10:26:42,118 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml' 2026-02-14T10:26:42,119 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml' 2026-02-14T10:26:42,121 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml' 2026-02-14T10:26:42,122 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml' 2026-02-14T10:26:42,123 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml' 2026-02-14T10:26:42,125 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml' 2026-02-14T10:26:42,126 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml' 2026-02-14T10:26:42,127 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml' 2026-02-14T10:26:42,129 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml' 2026-02-14T10:26:42,130 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml' 2026-02-14T10:26:42,132 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml' 2026-02-14T10:26:42,133 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml' 2026-02-14T10:26:42,134 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml' 2026-02-14T10:26:42,136 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml' 2026-02-14T10:26:42,137 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,138 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,140 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml' 2026-02-14T10:26:42,141 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml' 2026-02-14T10:26:42,142 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml' 2026-02-14T10:26:42,144 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml' 2026-02-14T10:26:42,145 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml' 2026-02-14T10:26:42,146 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml' 2026-02-14T10:26:42,148 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml' 2026-02-14T10:26:42,149 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml' 2026-02-14T10:26:42,150 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml' 2026-02-14T10:26:42,151 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml' 2026-02-14T10:26:42,152 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml' 2026-02-14T10:26:42,153 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml' 2026-02-14T10:26:42,154 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml' 2026-02-14T10:26:42,156 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml' 2026-02-14T10:26:42,157 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml' 2026-02-14T10:26:42,158 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml' 2026-02-14T10:26:42,159 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml' 2026-02-14T10:26:42,160 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml' 2026-02-14T10:26:42,162 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml' 2026-02-14T10:26:42,163 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml' 2026-02-14T10:26:42,165 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml' 2026-02-14T10:26:42,166 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml' 2026-02-14T10:26:42,168 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml' 2026-02-14T10:26:42,169 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml' 2026-02-14T10:26:42,171 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml' 2026-02-14T10:26:42,172 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml' 2026-02-14T10:26:42,173 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml' 2026-02-14T10:26:42,174 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml' 2026-02-14T10:26:42,175 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml' 2026-02-14T10:26:42,177 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml' 2026-02-14T10:26:42,178 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml' 2026-02-14T10:26:42,179 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml' 2026-02-14T10:26:42,180 adding 'lm_eval/tasks/global_mmlu/full/pl/utils.py' 2026-02-14T10:26:42,183 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml' 2026-02-14T10:26:42,184 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml' 2026-02-14T10:26:42,186 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml' 2026-02-14T10:26:42,187 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml' 2026-02-14T10:26:42,188 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml' 2026-02-14T10:26:42,189 adding 'lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml' 2026-02-14T10:26:42,190 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml' 2026-02-14T10:26:42,192 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml' 2026-02-14T10:26:42,193 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml' 2026-02-14T10:26:42,194 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml' 2026-02-14T10:26:42,195 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml' 2026-02-14T10:26:42,196 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml' 2026-02-14T10:26:42,197 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml' 2026-02-14T10:26:42,198 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml' 2026-02-14T10:26:42,200 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml' 2026-02-14T10:26:42,201 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml' 2026-02-14T10:26:42,202 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml' 2026-02-14T10:26:42,203 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml' 2026-02-14T10:26:42,204 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml' 2026-02-14T10:26:42,206 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml' 2026-02-14T10:26:42,207 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml' 2026-02-14T10:26:42,208 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml' 2026-02-14T10:26:42,209 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml' 2026-02-14T10:26:42,210 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml' 2026-02-14T10:26:42,212 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml' 2026-02-14T10:26:42,213 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml' 2026-02-14T10:26:42,214 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml' 2026-02-14T10:26:42,215 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml' 2026-02-14T10:26:42,216 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml' 2026-02-14T10:26:42,218 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,219 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,220 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml' 2026-02-14T10:26:42,221 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml' 2026-02-14T10:26:42,223 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml' 2026-02-14T10:26:42,224 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml' 2026-02-14T10:26:42,225 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml' 2026-02-14T10:26:42,226 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml' 2026-02-14T10:26:42,227 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml' 2026-02-14T10:26:42,228 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml' 2026-02-14T10:26:42,229 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml' 2026-02-14T10:26:42,230 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml' 2026-02-14T10:26:42,232 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml' 2026-02-14T10:26:42,233 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml' 2026-02-14T10:26:42,234 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml' 2026-02-14T10:26:42,235 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml' 2026-02-14T10:26:42,237 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml' 2026-02-14T10:26:42,238 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml' 2026-02-14T10:26:42,239 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml' 2026-02-14T10:26:42,240 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml' 2026-02-14T10:26:42,241 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml' 2026-02-14T10:26:42,242 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml' 2026-02-14T10:26:42,243 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml' 2026-02-14T10:26:42,245 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml' 2026-02-14T10:26:42,246 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml' 2026-02-14T10:26:42,247 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml' 2026-02-14T10:26:42,248 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml' 2026-02-14T10:26:42,249 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml' 2026-02-14T10:26:42,250 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml' 2026-02-14T10:26:42,252 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml' 2026-02-14T10:26:42,253 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml' 2026-02-14T10:26:42,254 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml' 2026-02-14T10:26:42,255 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml' 2026-02-14T10:26:42,256 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml' 2026-02-14T10:26:42,258 adding 'lm_eval/tasks/global_mmlu/full/pt/utils.py' 2026-02-14T10:26:42,261 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml' 2026-02-14T10:26:42,262 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml' 2026-02-14T10:26:42,263 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml' 2026-02-14T10:26:42,265 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml' 2026-02-14T10:26:42,266 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml' 2026-02-14T10:26:42,267 adding 'lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml' 2026-02-14T10:26:42,268 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml' 2026-02-14T10:26:42,270 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml' 2026-02-14T10:26:42,271 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml' 2026-02-14T10:26:42,272 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml' 2026-02-14T10:26:42,273 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml' 2026-02-14T10:26:42,274 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml' 2026-02-14T10:26:42,275 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml' 2026-02-14T10:26:42,277 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml' 2026-02-14T10:26:42,278 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml' 2026-02-14T10:26:42,279 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml' 2026-02-14T10:26:42,280 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml' 2026-02-14T10:26:42,281 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml' 2026-02-14T10:26:42,282 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml' 2026-02-14T10:26:42,283 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml' 2026-02-14T10:26:42,285 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml' 2026-02-14T10:26:42,286 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml' 2026-02-14T10:26:42,287 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml' 2026-02-14T10:26:42,288 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml' 2026-02-14T10:26:42,289 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml' 2026-02-14T10:26:42,290 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml' 2026-02-14T10:26:42,292 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml' 2026-02-14T10:26:42,293 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml' 2026-02-14T10:26:42,294 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml' 2026-02-14T10:26:42,295 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,296 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,298 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml' 2026-02-14T10:26:42,299 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml' 2026-02-14T10:26:42,300 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml' 2026-02-14T10:26:42,301 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml' 2026-02-14T10:26:42,303 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml' 2026-02-14T10:26:42,304 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml' 2026-02-14T10:26:42,305 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml' 2026-02-14T10:26:42,307 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml' 2026-02-14T10:26:42,308 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml' 2026-02-14T10:26:42,309 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml' 2026-02-14T10:26:42,310 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml' 2026-02-14T10:26:42,311 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml' 2026-02-14T10:26:42,313 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml' 2026-02-14T10:26:42,314 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml' 2026-02-14T10:26:42,315 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml' 2026-02-14T10:26:42,316 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml' 2026-02-14T10:26:42,317 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml' 2026-02-14T10:26:42,318 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml' 2026-02-14T10:26:42,319 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml' 2026-02-14T10:26:42,321 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml' 2026-02-14T10:26:42,322 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml' 2026-02-14T10:26:42,323 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml' 2026-02-14T10:26:42,324 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml' 2026-02-14T10:26:42,325 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml' 2026-02-14T10:26:42,326 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml' 2026-02-14T10:26:42,327 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml' 2026-02-14T10:26:42,329 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml' 2026-02-14T10:26:42,330 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml' 2026-02-14T10:26:42,331 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml' 2026-02-14T10:26:42,332 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml' 2026-02-14T10:26:42,333 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml' 2026-02-14T10:26:42,335 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml' 2026-02-14T10:26:42,336 adding 'lm_eval/tasks/global_mmlu/full/ro/utils.py' 2026-02-14T10:26:42,339 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml' 2026-02-14T10:26:42,341 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml' 2026-02-14T10:26:42,342 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml' 2026-02-14T10:26:42,343 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml' 2026-02-14T10:26:42,344 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml' 2026-02-14T10:26:42,346 adding 'lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml' 2026-02-14T10:26:42,347 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml' 2026-02-14T10:26:42,348 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml' 2026-02-14T10:26:42,350 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml' 2026-02-14T10:26:42,351 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml' 2026-02-14T10:26:42,352 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml' 2026-02-14T10:26:42,353 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml' 2026-02-14T10:26:42,354 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml' 2026-02-14T10:26:42,355 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml' 2026-02-14T10:26:42,356 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml' 2026-02-14T10:26:42,358 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml' 2026-02-14T10:26:42,359 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml' 2026-02-14T10:26:42,360 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml' 2026-02-14T10:26:42,361 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml' 2026-02-14T10:26:42,362 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml' 2026-02-14T10:26:42,363 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml' 2026-02-14T10:26:42,364 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml' 2026-02-14T10:26:42,366 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml' 2026-02-14T10:26:42,367 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml' 2026-02-14T10:26:42,368 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml' 2026-02-14T10:26:42,369 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml' 2026-02-14T10:26:42,370 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml' 2026-02-14T10:26:42,371 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml' 2026-02-14T10:26:42,372 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml' 2026-02-14T10:26:42,374 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,375 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,376 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml' 2026-02-14T10:26:42,377 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml' 2026-02-14T10:26:42,379 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml' 2026-02-14T10:26:42,380 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml' 2026-02-14T10:26:42,381 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml' 2026-02-14T10:26:42,383 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml' 2026-02-14T10:26:42,384 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml' 2026-02-14T10:26:42,386 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml' 2026-02-14T10:26:42,387 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml' 2026-02-14T10:26:42,388 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml' 2026-02-14T10:26:42,389 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml' 2026-02-14T10:26:42,391 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml' 2026-02-14T10:26:42,392 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml' 2026-02-14T10:26:42,394 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml' 2026-02-14T10:26:42,395 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml' 2026-02-14T10:26:42,396 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml' 2026-02-14T10:26:42,397 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml' 2026-02-14T10:26:42,398 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml' 2026-02-14T10:26:42,399 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml' 2026-02-14T10:26:42,401 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml' 2026-02-14T10:26:42,402 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml' 2026-02-14T10:26:42,403 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml' 2026-02-14T10:26:42,404 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml' 2026-02-14T10:26:42,405 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml' 2026-02-14T10:26:42,406 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml' 2026-02-14T10:26:42,408 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml' 2026-02-14T10:26:42,409 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml' 2026-02-14T10:26:42,410 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml' 2026-02-14T10:26:42,411 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml' 2026-02-14T10:26:42,412 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml' 2026-02-14T10:26:42,413 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml' 2026-02-14T10:26:42,414 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml' 2026-02-14T10:26:42,416 adding 'lm_eval/tasks/global_mmlu/full/ru/utils.py' 2026-02-14T10:26:42,419 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml' 2026-02-14T10:26:42,420 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml' 2026-02-14T10:26:42,421 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml' 2026-02-14T10:26:42,422 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml' 2026-02-14T10:26:42,423 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml' 2026-02-14T10:26:42,424 adding 'lm_eval/tasks/global_mmlu/full/si/_si_template_yaml' 2026-02-14T10:26:42,425 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml' 2026-02-14T10:26:42,427 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml' 2026-02-14T10:26:42,428 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml' 2026-02-14T10:26:42,429 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml' 2026-02-14T10:26:42,430 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml' 2026-02-14T10:26:42,431 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml' 2026-02-14T10:26:42,432 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml' 2026-02-14T10:26:42,434 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml' 2026-02-14T10:26:42,435 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml' 2026-02-14T10:26:42,436 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml' 2026-02-14T10:26:42,437 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml' 2026-02-14T10:26:42,438 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml' 2026-02-14T10:26:42,439 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml' 2026-02-14T10:26:42,441 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml' 2026-02-14T10:26:42,442 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml' 2026-02-14T10:26:42,443 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml' 2026-02-14T10:26:42,444 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml' 2026-02-14T10:26:42,445 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml' 2026-02-14T10:26:42,446 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml' 2026-02-14T10:26:42,448 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml' 2026-02-14T10:26:42,449 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml' 2026-02-14T10:26:42,450 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml' 2026-02-14T10:26:42,451 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml' 2026-02-14T10:26:42,452 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,453 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,454 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml' 2026-02-14T10:26:42,456 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml' 2026-02-14T10:26:42,457 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml' 2026-02-14T10:26:42,458 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml' 2026-02-14T10:26:42,459 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml' 2026-02-14T10:26:42,460 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml' 2026-02-14T10:26:42,461 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml' 2026-02-14T10:26:42,462 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml' 2026-02-14T10:26:42,464 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml' 2026-02-14T10:26:42,465 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml' 2026-02-14T10:26:42,466 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml' 2026-02-14T10:26:42,467 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml' 2026-02-14T10:26:42,468 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml' 2026-02-14T10:26:42,469 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml' 2026-02-14T10:26:42,470 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml' 2026-02-14T10:26:42,472 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml' 2026-02-14T10:26:42,473 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml' 2026-02-14T10:26:42,474 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml' 2026-02-14T10:26:42,475 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml' 2026-02-14T10:26:42,476 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml' 2026-02-14T10:26:42,477 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml' 2026-02-14T10:26:42,479 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml' 2026-02-14T10:26:42,480 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml' 2026-02-14T10:26:42,481 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml' 2026-02-14T10:26:42,482 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml' 2026-02-14T10:26:42,483 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml' 2026-02-14T10:26:42,484 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml' 2026-02-14T10:26:42,486 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml' 2026-02-14T10:26:42,487 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml' 2026-02-14T10:26:42,488 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml' 2026-02-14T10:26:42,489 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml' 2026-02-14T10:26:42,490 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml' 2026-02-14T10:26:42,492 adding 'lm_eval/tasks/global_mmlu/full/si/utils.py' 2026-02-14T10:26:42,494 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml' 2026-02-14T10:26:42,495 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml' 2026-02-14T10:26:42,497 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml' 2026-02-14T10:26:42,498 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml' 2026-02-14T10:26:42,499 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml' 2026-02-14T10:26:42,500 adding 'lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml' 2026-02-14T10:26:42,501 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml' 2026-02-14T10:26:42,502 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml' 2026-02-14T10:26:42,503 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml' 2026-02-14T10:26:42,504 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml' 2026-02-14T10:26:42,505 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml' 2026-02-14T10:26:42,507 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml' 2026-02-14T10:26:42,508 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml' 2026-02-14T10:26:42,509 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml' 2026-02-14T10:26:42,510 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml' 2026-02-14T10:26:42,511 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml' 2026-02-14T10:26:42,512 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml' 2026-02-14T10:26:42,513 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml' 2026-02-14T10:26:42,514 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml' 2026-02-14T10:26:42,516 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml' 2026-02-14T10:26:42,517 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml' 2026-02-14T10:26:42,518 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml' 2026-02-14T10:26:42,519 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml' 2026-02-14T10:26:42,520 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml' 2026-02-14T10:26:42,521 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml' 2026-02-14T10:26:42,523 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml' 2026-02-14T10:26:42,524 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml' 2026-02-14T10:26:42,525 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml' 2026-02-14T10:26:42,526 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml' 2026-02-14T10:26:42,527 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,529 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,530 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml' 2026-02-14T10:26:42,531 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml' 2026-02-14T10:26:42,532 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml' 2026-02-14T10:26:42,534 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml' 2026-02-14T10:26:42,535 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml' 2026-02-14T10:26:42,536 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml' 2026-02-14T10:26:42,537 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml' 2026-02-14T10:26:42,538 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml' 2026-02-14T10:26:42,540 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml' 2026-02-14T10:26:42,541 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml' 2026-02-14T10:26:42,542 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml' 2026-02-14T10:26:42,543 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml' 2026-02-14T10:26:42,544 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml' 2026-02-14T10:26:42,545 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml' 2026-02-14T10:26:42,547 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml' 2026-02-14T10:26:42,548 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml' 2026-02-14T10:26:42,549 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml' 2026-02-14T10:26:42,550 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml' 2026-02-14T10:26:42,551 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml' 2026-02-14T10:26:42,552 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml' 2026-02-14T10:26:42,553 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml' 2026-02-14T10:26:42,554 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml' 2026-02-14T10:26:42,556 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml' 2026-02-14T10:26:42,557 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml' 2026-02-14T10:26:42,558 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml' 2026-02-14T10:26:42,559 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml' 2026-02-14T10:26:42,560 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml' 2026-02-14T10:26:42,561 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml' 2026-02-14T10:26:42,562 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml' 2026-02-14T10:26:42,564 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml' 2026-02-14T10:26:42,565 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml' 2026-02-14T10:26:42,566 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml' 2026-02-14T10:26:42,567 adding 'lm_eval/tasks/global_mmlu/full/sn/utils.py' 2026-02-14T10:26:42,570 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml' 2026-02-14T10:26:42,571 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml' 2026-02-14T10:26:42,572 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml' 2026-02-14T10:26:42,574 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml' 2026-02-14T10:26:42,575 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml' 2026-02-14T10:26:42,576 adding 'lm_eval/tasks/global_mmlu/full/so/_so_template_yaml' 2026-02-14T10:26:42,577 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml' 2026-02-14T10:26:42,578 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml' 2026-02-14T10:26:42,580 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml' 2026-02-14T10:26:42,581 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml' 2026-02-14T10:26:42,582 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml' 2026-02-14T10:26:42,583 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml' 2026-02-14T10:26:42,584 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml' 2026-02-14T10:26:42,585 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml' 2026-02-14T10:26:42,586 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml' 2026-02-14T10:26:42,587 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml' 2026-02-14T10:26:42,588 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml' 2026-02-14T10:26:42,590 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml' 2026-02-14T10:26:42,591 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml' 2026-02-14T10:26:42,592 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml' 2026-02-14T10:26:42,593 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml' 2026-02-14T10:26:42,594 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml' 2026-02-14T10:26:42,595 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml' 2026-02-14T10:26:42,596 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml' 2026-02-14T10:26:42,597 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml' 2026-02-14T10:26:42,598 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml' 2026-02-14T10:26:42,600 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml' 2026-02-14T10:26:42,601 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml' 2026-02-14T10:26:42,602 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml' 2026-02-14T10:26:42,603 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,604 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,606 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml' 2026-02-14T10:26:42,607 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml' 2026-02-14T10:26:42,608 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml' 2026-02-14T10:26:42,609 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml' 2026-02-14T10:26:42,610 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml' 2026-02-14T10:26:42,611 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml' 2026-02-14T10:26:42,613 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml' 2026-02-14T10:26:42,614 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml' 2026-02-14T10:26:42,615 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml' 2026-02-14T10:26:42,616 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml' 2026-02-14T10:26:42,617 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml' 2026-02-14T10:26:42,619 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml' 2026-02-14T10:26:42,620 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml' 2026-02-14T10:26:42,621 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml' 2026-02-14T10:26:42,622 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml' 2026-02-14T10:26:42,624 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml' 2026-02-14T10:26:42,625 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml' 2026-02-14T10:26:42,626 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml' 2026-02-14T10:26:42,627 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml' 2026-02-14T10:26:42,628 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml' 2026-02-14T10:26:42,629 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml' 2026-02-14T10:26:42,630 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml' 2026-02-14T10:26:42,631 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml' 2026-02-14T10:26:42,633 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml' 2026-02-14T10:26:42,634 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml' 2026-02-14T10:26:42,635 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml' 2026-02-14T10:26:42,636 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml' 2026-02-14T10:26:42,637 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml' 2026-02-14T10:26:42,639 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml' 2026-02-14T10:26:42,640 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml' 2026-02-14T10:26:42,641 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml' 2026-02-14T10:26:42,642 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml' 2026-02-14T10:26:42,643 adding 'lm_eval/tasks/global_mmlu/full/so/utils.py' 2026-02-14T10:26:42,647 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml' 2026-02-14T10:26:42,648 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml' 2026-02-14T10:26:42,649 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml' 2026-02-14T10:26:42,650 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml' 2026-02-14T10:26:42,651 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml' 2026-02-14T10:26:42,653 adding 'lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml' 2026-02-14T10:26:42,654 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml' 2026-02-14T10:26:42,655 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml' 2026-02-14T10:26:42,656 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml' 2026-02-14T10:26:42,657 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml' 2026-02-14T10:26:42,659 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml' 2026-02-14T10:26:42,660 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml' 2026-02-14T10:26:42,661 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml' 2026-02-14T10:26:42,662 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml' 2026-02-14T10:26:42,663 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml' 2026-02-14T10:26:42,665 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml' 2026-02-14T10:26:42,666 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml' 2026-02-14T10:26:42,667 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml' 2026-02-14T10:26:42,668 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml' 2026-02-14T10:26:42,670 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml' 2026-02-14T10:26:42,671 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml' 2026-02-14T10:26:42,672 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml' 2026-02-14T10:26:42,673 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml' 2026-02-14T10:26:42,674 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml' 2026-02-14T10:26:42,675 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml' 2026-02-14T10:26:42,676 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml' 2026-02-14T10:26:42,677 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml' 2026-02-14T10:26:42,678 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml' 2026-02-14T10:26:42,679 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml' 2026-02-14T10:26:42,681 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,682 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,683 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml' 2026-02-14T10:26:42,684 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml' 2026-02-14T10:26:42,685 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml' 2026-02-14T10:26:42,687 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml' 2026-02-14T10:26:42,688 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml' 2026-02-14T10:26:42,689 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml' 2026-02-14T10:26:42,690 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml' 2026-02-14T10:26:42,691 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml' 2026-02-14T10:26:42,692 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml' 2026-02-14T10:26:42,694 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml' 2026-02-14T10:26:42,695 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml' 2026-02-14T10:26:42,696 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml' 2026-02-14T10:26:42,697 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml' 2026-02-14T10:26:42,699 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml' 2026-02-14T10:26:42,700 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml' 2026-02-14T10:26:42,701 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml' 2026-02-14T10:26:42,702 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml' 2026-02-14T10:26:42,704 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml' 2026-02-14T10:26:42,705 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml' 2026-02-14T10:26:42,706 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml' 2026-02-14T10:26:42,707 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml' 2026-02-14T10:26:42,708 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml' 2026-02-14T10:26:42,710 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml' 2026-02-14T10:26:42,711 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml' 2026-02-14T10:26:42,712 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml' 2026-02-14T10:26:42,714 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml' 2026-02-14T10:26:42,715 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml' 2026-02-14T10:26:42,716 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml' 2026-02-14T10:26:42,718 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml' 2026-02-14T10:26:42,719 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml' 2026-02-14T10:26:42,720 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml' 2026-02-14T10:26:42,721 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml' 2026-02-14T10:26:42,722 adding 'lm_eval/tasks/global_mmlu/full/sr/utils.py' 2026-02-14T10:26:42,725 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml' 2026-02-14T10:26:42,727 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml' 2026-02-14T10:26:42,728 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml' 2026-02-14T10:26:42,729 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml' 2026-02-14T10:26:42,730 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml' 2026-02-14T10:26:42,731 adding 'lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml' 2026-02-14T10:26:42,733 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml' 2026-02-14T10:26:42,734 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml' 2026-02-14T10:26:42,735 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml' 2026-02-14T10:26:42,736 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml' 2026-02-14T10:26:42,737 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml' 2026-02-14T10:26:42,739 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml' 2026-02-14T10:26:42,740 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml' 2026-02-14T10:26:42,741 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml' 2026-02-14T10:26:42,742 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml' 2026-02-14T10:26:42,743 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml' 2026-02-14T10:26:42,744 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml' 2026-02-14T10:26:42,746 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml' 2026-02-14T10:26:42,747 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml' 2026-02-14T10:26:42,748 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml' 2026-02-14T10:26:42,749 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml' 2026-02-14T10:26:42,751 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml' 2026-02-14T10:26:42,752 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml' 2026-02-14T10:26:42,753 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml' 2026-02-14T10:26:42,754 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml' 2026-02-14T10:26:42,756 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml' 2026-02-14T10:26:42,757 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml' 2026-02-14T10:26:42,758 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml' 2026-02-14T10:26:42,759 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml' 2026-02-14T10:26:42,761 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,762 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,763 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml' 2026-02-14T10:26:42,764 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml' 2026-02-14T10:26:42,765 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml' 2026-02-14T10:26:42,766 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml' 2026-02-14T10:26:42,768 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml' 2026-02-14T10:26:42,769 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml' 2026-02-14T10:26:42,770 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml' 2026-02-14T10:26:42,771 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml' 2026-02-14T10:26:42,772 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml' 2026-02-14T10:26:42,773 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml' 2026-02-14T10:26:42,774 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml' 2026-02-14T10:26:42,776 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml' 2026-02-14T10:26:42,777 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml' 2026-02-14T10:26:42,778 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml' 2026-02-14T10:26:42,779 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml' 2026-02-14T10:26:42,780 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml' 2026-02-14T10:26:42,781 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml' 2026-02-14T10:26:42,783 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml' 2026-02-14T10:26:42,784 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml' 2026-02-14T10:26:42,785 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml' 2026-02-14T10:26:42,786 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml' 2026-02-14T10:26:42,787 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml' 2026-02-14T10:26:42,788 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml' 2026-02-14T10:26:42,789 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml' 2026-02-14T10:26:42,791 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml' 2026-02-14T10:26:42,792 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml' 2026-02-14T10:26:42,793 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml' 2026-02-14T10:26:42,794 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml' 2026-02-14T10:26:42,795 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml' 2026-02-14T10:26:42,797 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml' 2026-02-14T10:26:42,798 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml' 2026-02-14T10:26:42,799 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml' 2026-02-14T10:26:42,800 adding 'lm_eval/tasks/global_mmlu/full/sv/utils.py' 2026-02-14T10:26:42,803 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml' 2026-02-14T10:26:42,804 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml' 2026-02-14T10:26:42,806 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml' 2026-02-14T10:26:42,807 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml' 2026-02-14T10:26:42,808 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml' 2026-02-14T10:26:42,809 adding 'lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml' 2026-02-14T10:26:42,810 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml' 2026-02-14T10:26:42,811 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml' 2026-02-14T10:26:42,812 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml' 2026-02-14T10:26:42,813 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml' 2026-02-14T10:26:42,815 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml' 2026-02-14T10:26:42,816 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml' 2026-02-14T10:26:42,817 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml' 2026-02-14T10:26:42,818 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml' 2026-02-14T10:26:42,819 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml' 2026-02-14T10:26:42,821 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml' 2026-02-14T10:26:42,822 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml' 2026-02-14T10:26:42,823 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml' 2026-02-14T10:26:42,824 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml' 2026-02-14T10:26:42,825 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml' 2026-02-14T10:26:42,827 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml' 2026-02-14T10:26:42,828 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml' 2026-02-14T10:26:42,829 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml' 2026-02-14T10:26:42,830 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml' 2026-02-14T10:26:42,831 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml' 2026-02-14T10:26:42,832 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml' 2026-02-14T10:26:42,834 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml' 2026-02-14T10:26:42,835 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml' 2026-02-14T10:26:42,836 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml' 2026-02-14T10:26:42,837 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,838 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,839 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml' 2026-02-14T10:26:42,841 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml' 2026-02-14T10:26:42,842 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml' 2026-02-14T10:26:42,843 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml' 2026-02-14T10:26:42,844 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml' 2026-02-14T10:26:42,845 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml' 2026-02-14T10:26:42,847 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml' 2026-02-14T10:26:42,848 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml' 2026-02-14T10:26:42,849 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml' 2026-02-14T10:26:42,850 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml' 2026-02-14T10:26:42,851 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml' 2026-02-14T10:26:42,852 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml' 2026-02-14T10:26:42,853 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml' 2026-02-14T10:26:42,854 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml' 2026-02-14T10:26:42,855 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml' 2026-02-14T10:26:42,857 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml' 2026-02-14T10:26:42,858 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml' 2026-02-14T10:26:42,859 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml' 2026-02-14T10:26:42,860 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml' 2026-02-14T10:26:42,862 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml' 2026-02-14T10:26:42,863 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml' 2026-02-14T10:26:42,864 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml' 2026-02-14T10:26:42,865 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml' 2026-02-14T10:26:42,866 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml' 2026-02-14T10:26:42,867 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml' 2026-02-14T10:26:42,869 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml' 2026-02-14T10:26:42,870 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml' 2026-02-14T10:26:42,871 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml' 2026-02-14T10:26:42,872 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml' 2026-02-14T10:26:42,873 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml' 2026-02-14T10:26:42,874 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml' 2026-02-14T10:26:42,875 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml' 2026-02-14T10:26:42,877 adding 'lm_eval/tasks/global_mmlu/full/sw/utils.py' 2026-02-14T10:26:42,880 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml' 2026-02-14T10:26:42,881 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml' 2026-02-14T10:26:42,882 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml' 2026-02-14T10:26:42,883 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml' 2026-02-14T10:26:42,884 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml' 2026-02-14T10:26:42,886 adding 'lm_eval/tasks/global_mmlu/full/te/_te_template_yaml' 2026-02-14T10:26:42,887 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml' 2026-02-14T10:26:42,888 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml' 2026-02-14T10:26:42,889 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml' 2026-02-14T10:26:42,890 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml' 2026-02-14T10:26:42,891 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml' 2026-02-14T10:26:42,892 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml' 2026-02-14T10:26:42,894 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml' 2026-02-14T10:26:42,895 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml' 2026-02-14T10:26:42,896 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml' 2026-02-14T10:26:42,897 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml' 2026-02-14T10:26:42,898 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml' 2026-02-14T10:26:42,899 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml' 2026-02-14T10:26:42,900 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml' 2026-02-14T10:26:42,901 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml' 2026-02-14T10:26:42,902 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml' 2026-02-14T10:26:42,904 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml' 2026-02-14T10:26:42,905 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml' 2026-02-14T10:26:42,906 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml' 2026-02-14T10:26:42,907 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml' 2026-02-14T10:26:42,908 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml' 2026-02-14T10:26:42,909 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml' 2026-02-14T10:26:42,910 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml' 2026-02-14T10:26:42,912 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml' 2026-02-14T10:26:42,913 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,914 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,915 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml' 2026-02-14T10:26:42,916 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml' 2026-02-14T10:26:42,918 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml' 2026-02-14T10:26:42,919 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml' 2026-02-14T10:26:42,920 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml' 2026-02-14T10:26:42,921 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml' 2026-02-14T10:26:42,922 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml' 2026-02-14T10:26:42,923 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml' 2026-02-14T10:26:42,925 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml' 2026-02-14T10:26:42,926 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml' 2026-02-14T10:26:42,927 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml' 2026-02-14T10:26:42,929 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml' 2026-02-14T10:26:42,930 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml' 2026-02-14T10:26:42,931 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml' 2026-02-14T10:26:42,932 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml' 2026-02-14T10:26:42,933 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml' 2026-02-14T10:26:42,934 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml' 2026-02-14T10:26:42,936 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml' 2026-02-14T10:26:42,937 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml' 2026-02-14T10:26:42,938 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml' 2026-02-14T10:26:42,939 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml' 2026-02-14T10:26:42,940 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml' 2026-02-14T10:26:42,941 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml' 2026-02-14T10:26:42,942 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml' 2026-02-14T10:26:42,943 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml' 2026-02-14T10:26:42,944 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml' 2026-02-14T10:26:42,946 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml' 2026-02-14T10:26:42,947 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml' 2026-02-14T10:26:42,948 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml' 2026-02-14T10:26:42,949 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml' 2026-02-14T10:26:42,950 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml' 2026-02-14T10:26:42,951 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml' 2026-02-14T10:26:42,952 adding 'lm_eval/tasks/global_mmlu/full/te/utils.py' 2026-02-14T10:26:42,955 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml' 2026-02-14T10:26:42,957 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml' 2026-02-14T10:26:42,958 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml' 2026-02-14T10:26:42,959 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml' 2026-02-14T10:26:42,960 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml' 2026-02-14T10:26:42,961 adding 'lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml' 2026-02-14T10:26:42,963 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml' 2026-02-14T10:26:42,964 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml' 2026-02-14T10:26:42,965 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml' 2026-02-14T10:26:42,966 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml' 2026-02-14T10:26:42,967 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml' 2026-02-14T10:26:42,968 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml' 2026-02-14T10:26:42,970 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml' 2026-02-14T10:26:42,971 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml' 2026-02-14T10:26:42,972 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml' 2026-02-14T10:26:42,973 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml' 2026-02-14T10:26:42,974 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml' 2026-02-14T10:26:42,975 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml' 2026-02-14T10:26:42,977 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml' 2026-02-14T10:26:42,978 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml' 2026-02-14T10:26:42,979 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml' 2026-02-14T10:26:42,980 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml' 2026-02-14T10:26:42,981 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml' 2026-02-14T10:26:42,983 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml' 2026-02-14T10:26:42,984 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml' 2026-02-14T10:26:42,985 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml' 2026-02-14T10:26:42,986 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml' 2026-02-14T10:26:42,987 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml' 2026-02-14T10:26:42,988 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml' 2026-02-14T10:26:42,989 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml' 2026-02-14T10:26:42,990 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml' 2026-02-14T10:26:42,991 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml' 2026-02-14T10:26:42,993 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml' 2026-02-14T10:26:42,994 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml' 2026-02-14T10:26:42,995 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml' 2026-02-14T10:26:42,996 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml' 2026-02-14T10:26:42,997 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml' 2026-02-14T10:26:42,998 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml' 2026-02-14T10:26:43,000 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml' 2026-02-14T10:26:43,001 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml' 2026-02-14T10:26:43,002 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml' 2026-02-14T10:26:43,003 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml' 2026-02-14T10:26:43,004 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml' 2026-02-14T10:26:43,005 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml' 2026-02-14T10:26:43,007 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml' 2026-02-14T10:26:43,008 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml' 2026-02-14T10:26:43,009 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml' 2026-02-14T10:26:43,010 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml' 2026-02-14T10:26:43,011 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml' 2026-02-14T10:26:43,012 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml' 2026-02-14T10:26:43,014 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml' 2026-02-14T10:26:43,015 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml' 2026-02-14T10:26:43,016 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml' 2026-02-14T10:26:43,017 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml' 2026-02-14T10:26:43,019 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml' 2026-02-14T10:26:43,020 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml' 2026-02-14T10:26:43,021 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml' 2026-02-14T10:26:43,022 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml' 2026-02-14T10:26:43,023 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml' 2026-02-14T10:26:43,024 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml' 2026-02-14T10:26:43,026 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml' 2026-02-14T10:26:43,027 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml' 2026-02-14T10:26:43,028 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml' 2026-02-14T10:26:43,029 adding 'lm_eval/tasks/global_mmlu/full/tr/utils.py' 2026-02-14T10:26:43,032 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml' 2026-02-14T10:26:43,033 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml' 2026-02-14T10:26:43,034 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml' 2026-02-14T10:26:43,036 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml' 2026-02-14T10:26:43,037 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml' 2026-02-14T10:26:43,038 adding 'lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml' 2026-02-14T10:26:43,039 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml' 2026-02-14T10:26:43,040 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml' 2026-02-14T10:26:43,042 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml' 2026-02-14T10:26:43,043 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml' 2026-02-14T10:26:43,044 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml' 2026-02-14T10:26:43,045 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml' 2026-02-14T10:26:43,046 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml' 2026-02-14T10:26:43,047 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml' 2026-02-14T10:26:43,049 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml' 2026-02-14T10:26:43,050 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml' 2026-02-14T10:26:43,051 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml' 2026-02-14T10:26:43,052 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml' 2026-02-14T10:26:43,053 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml' 2026-02-14T10:26:43,054 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml' 2026-02-14T10:26:43,056 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml' 2026-02-14T10:26:43,057 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml' 2026-02-14T10:26:43,058 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml' 2026-02-14T10:26:43,059 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml' 2026-02-14T10:26:43,060 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml' 2026-02-14T10:26:43,062 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml' 2026-02-14T10:26:43,063 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml' 2026-02-14T10:26:43,064 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml' 2026-02-14T10:26:43,066 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml' 2026-02-14T10:26:43,067 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml' 2026-02-14T10:26:43,068 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml' 2026-02-14T10:26:43,069 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml' 2026-02-14T10:26:43,070 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml' 2026-02-14T10:26:43,071 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml' 2026-02-14T10:26:43,072 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml' 2026-02-14T10:26:43,074 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml' 2026-02-14T10:26:43,075 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml' 2026-02-14T10:26:43,076 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml' 2026-02-14T10:26:43,077 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml' 2026-02-14T10:26:43,078 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml' 2026-02-14T10:26:43,079 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml' 2026-02-14T10:26:43,080 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml' 2026-02-14T10:26:43,081 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml' 2026-02-14T10:26:43,082 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml' 2026-02-14T10:26:43,084 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml' 2026-02-14T10:26:43,085 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml' 2026-02-14T10:26:43,086 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml' 2026-02-14T10:26:43,087 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml' 2026-02-14T10:26:43,088 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml' 2026-02-14T10:26:43,089 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml' 2026-02-14T10:26:43,090 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml' 2026-02-14T10:26:43,092 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml' 2026-02-14T10:26:43,093 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml' 2026-02-14T10:26:43,094 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml' 2026-02-14T10:26:43,095 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml' 2026-02-14T10:26:43,096 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml' 2026-02-14T10:26:43,097 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml' 2026-02-14T10:26:43,099 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml' 2026-02-14T10:26:43,100 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml' 2026-02-14T10:26:43,101 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml' 2026-02-14T10:26:43,102 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml' 2026-02-14T10:26:43,103 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml' 2026-02-14T10:26:43,105 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml' 2026-02-14T10:26:43,106 adding 'lm_eval/tasks/global_mmlu/full/uk/utils.py' 2026-02-14T10:26:43,109 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml' 2026-02-14T10:26:43,110 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml' 2026-02-14T10:26:43,111 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml' 2026-02-14T10:26:43,113 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml' 2026-02-14T10:26:43,114 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml' 2026-02-14T10:26:43,115 adding 'lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml' 2026-02-14T10:26:43,116 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml' 2026-02-14T10:26:43,117 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml' 2026-02-14T10:26:43,118 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml' 2026-02-14T10:26:43,119 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml' 2026-02-14T10:26:43,121 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml' 2026-02-14T10:26:43,122 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml' 2026-02-14T10:26:43,123 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml' 2026-02-14T10:26:43,124 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml' 2026-02-14T10:26:43,125 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml' 2026-02-14T10:26:43,126 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml' 2026-02-14T10:26:43,127 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml' 2026-02-14T10:26:43,128 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml' 2026-02-14T10:26:43,129 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml' 2026-02-14T10:26:43,130 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml' 2026-02-14T10:26:43,131 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml' 2026-02-14T10:26:43,132 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml' 2026-02-14T10:26:43,133 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml' 2026-02-14T10:26:43,135 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml' 2026-02-14T10:26:43,136 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml' 2026-02-14T10:26:43,137 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml' 2026-02-14T10:26:43,138 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml' 2026-02-14T10:26:43,139 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml' 2026-02-14T10:26:43,140 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml' 2026-02-14T10:26:43,141 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml' 2026-02-14T10:26:43,143 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml' 2026-02-14T10:26:43,144 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml' 2026-02-14T10:26:43,145 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml' 2026-02-14T10:26:43,146 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml' 2026-02-14T10:26:43,147 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml' 2026-02-14T10:26:43,148 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml' 2026-02-14T10:26:43,150 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml' 2026-02-14T10:26:43,151 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml' 2026-02-14T10:26:43,152 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml' 2026-02-14T10:26:43,153 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml' 2026-02-14T10:26:43,154 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml' 2026-02-14T10:26:43,156 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml' 2026-02-14T10:26:43,157 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml' 2026-02-14T10:26:43,158 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml' 2026-02-14T10:26:43,159 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml' 2026-02-14T10:26:43,160 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml' 2026-02-14T10:26:43,161 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml' 2026-02-14T10:26:43,162 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml' 2026-02-14T10:26:43,163 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml' 2026-02-14T10:26:43,164 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml' 2026-02-14T10:26:43,165 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml' 2026-02-14T10:26:43,166 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml' 2026-02-14T10:26:43,168 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml' 2026-02-14T10:26:43,169 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml' 2026-02-14T10:26:43,170 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml' 2026-02-14T10:26:43,171 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml' 2026-02-14T10:26:43,172 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml' 2026-02-14T10:26:43,173 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml' 2026-02-14T10:26:43,174 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml' 2026-02-14T10:26:43,175 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml' 2026-02-14T10:26:43,177 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml' 2026-02-14T10:26:43,178 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml' 2026-02-14T10:26:43,179 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml' 2026-02-14T10:26:43,180 adding 'lm_eval/tasks/global_mmlu/full/vi/utils.py' 2026-02-14T10:26:43,183 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml' 2026-02-14T10:26:43,184 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml' 2026-02-14T10:26:43,186 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml' 2026-02-14T10:26:43,187 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml' 2026-02-14T10:26:43,188 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml' 2026-02-14T10:26:43,189 adding 'lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml' 2026-02-14T10:26:43,190 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml' 2026-02-14T10:26:43,192 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml' 2026-02-14T10:26:43,193 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml' 2026-02-14T10:26:43,194 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml' 2026-02-14T10:26:43,195 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml' 2026-02-14T10:26:43,196 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml' 2026-02-14T10:26:43,198 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml' 2026-02-14T10:26:43,199 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml' 2026-02-14T10:26:43,200 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml' 2026-02-14T10:26:43,201 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml' 2026-02-14T10:26:43,202 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml' 2026-02-14T10:26:43,204 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml' 2026-02-14T10:26:43,205 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml' 2026-02-14T10:26:43,207 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml' 2026-02-14T10:26:43,208 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml' 2026-02-14T10:26:43,209 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml' 2026-02-14T10:26:43,210 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml' 2026-02-14T10:26:43,211 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml' 2026-02-14T10:26:43,212 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml' 2026-02-14T10:26:43,213 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml' 2026-02-14T10:26:43,214 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml' 2026-02-14T10:26:43,215 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml' 2026-02-14T10:26:43,217 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml' 2026-02-14T10:26:43,218 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml' 2026-02-14T10:26:43,219 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml' 2026-02-14T10:26:43,220 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml' 2026-02-14T10:26:43,221 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml' 2026-02-14T10:26:43,223 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml' 2026-02-14T10:26:43,224 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml' 2026-02-14T10:26:43,225 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml' 2026-02-14T10:26:43,227 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml' 2026-02-14T10:26:43,228 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml' 2026-02-14T10:26:43,229 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml' 2026-02-14T10:26:43,230 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml' 2026-02-14T10:26:43,231 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml' 2026-02-14T10:26:43,233 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml' 2026-02-14T10:26:43,234 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml' 2026-02-14T10:26:43,235 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml' 2026-02-14T10:26:43,236 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml' 2026-02-14T10:26:43,237 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml' 2026-02-14T10:26:43,238 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml' 2026-02-14T10:26:43,240 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml' 2026-02-14T10:26:43,241 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml' 2026-02-14T10:26:43,242 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml' 2026-02-14T10:26:43,243 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml' 2026-02-14T10:26:43,244 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml' 2026-02-14T10:26:43,246 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml' 2026-02-14T10:26:43,247 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml' 2026-02-14T10:26:43,248 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml' 2026-02-14T10:26:43,249 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml' 2026-02-14T10:26:43,250 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml' 2026-02-14T10:26:43,251 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml' 2026-02-14T10:26:43,252 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml' 2026-02-14T10:26:43,253 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml' 2026-02-14T10:26:43,254 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml' 2026-02-14T10:26:43,255 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml' 2026-02-14T10:26:43,256 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml' 2026-02-14T10:26:43,258 adding 'lm_eval/tasks/global_mmlu/full/yo/utils.py' 2026-02-14T10:26:43,261 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml' 2026-02-14T10:26:43,262 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml' 2026-02-14T10:26:43,263 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml' 2026-02-14T10:26:43,264 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml' 2026-02-14T10:26:43,265 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml' 2026-02-14T10:26:43,266 adding 'lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml' 2026-02-14T10:26:43,268 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml' 2026-02-14T10:26:43,269 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml' 2026-02-14T10:26:43,270 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml' 2026-02-14T10:26:43,271 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml' 2026-02-14T10:26:43,272 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml' 2026-02-14T10:26:43,273 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml' 2026-02-14T10:26:43,274 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml' 2026-02-14T10:26:43,275 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml' 2026-02-14T10:26:43,277 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml' 2026-02-14T10:26:43,278 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml' 2026-02-14T10:26:43,279 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml' 2026-02-14T10:26:43,280 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml' 2026-02-14T10:26:43,281 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml' 2026-02-14T10:26:43,282 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml' 2026-02-14T10:26:43,284 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml' 2026-02-14T10:26:43,285 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml' 2026-02-14T10:26:43,286 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml' 2026-02-14T10:26:43,287 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml' 2026-02-14T10:26:43,288 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml' 2026-02-14T10:26:43,289 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml' 2026-02-14T10:26:43,291 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml' 2026-02-14T10:26:43,292 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml' 2026-02-14T10:26:43,293 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml' 2026-02-14T10:26:43,294 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml' 2026-02-14T10:26:43,295 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml' 2026-02-14T10:26:43,296 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml' 2026-02-14T10:26:43,297 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml' 2026-02-14T10:26:43,298 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml' 2026-02-14T10:26:43,299 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml' 2026-02-14T10:26:43,300 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml' 2026-02-14T10:26:43,301 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml' 2026-02-14T10:26:43,303 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml' 2026-02-14T10:26:43,304 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml' 2026-02-14T10:26:43,305 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml' 2026-02-14T10:26:43,306 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml' 2026-02-14T10:26:43,307 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml' 2026-02-14T10:26:43,308 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml' 2026-02-14T10:26:43,309 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml' 2026-02-14T10:26:43,310 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml' 2026-02-14T10:26:43,312 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml' 2026-02-14T10:26:43,313 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml' 2026-02-14T10:26:43,314 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml' 2026-02-14T10:26:43,315 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml' 2026-02-14T10:26:43,316 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml' 2026-02-14T10:26:43,317 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml' 2026-02-14T10:26:43,319 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml' 2026-02-14T10:26:43,320 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml' 2026-02-14T10:26:43,321 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml' 2026-02-14T10:26:43,322 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml' 2026-02-14T10:26:43,323 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml' 2026-02-14T10:26:43,324 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml' 2026-02-14T10:26:43,326 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml' 2026-02-14T10:26:43,327 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml' 2026-02-14T10:26:43,328 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml' 2026-02-14T10:26:43,329 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml' 2026-02-14T10:26:43,330 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml' 2026-02-14T10:26:43,331 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml' 2026-02-14T10:26:43,333 adding 'lm_eval/tasks/global_mmlu/full/zh/utils.py' 2026-02-14T10:26:43,334 adding 'lm_eval/tasks/global_piqa/README.md' 2026-02-14T10:26:43,338 adding 'lm_eval/tasks/global_piqa/completions/_generate_config.py' 2026-02-14T10:26:43,340 adding 'lm_eval/tasks/global_piqa/completions/_global_piqa.yaml' 2026-02-14T10:26:43,341 adding 'lm_eval/tasks/global_piqa/completions/_template' 2026-02-14T10:26:43,342 adding 'lm_eval/tasks/global_piqa/completions/acm_arab.yaml' 2026-02-14T10:26:43,343 adding 'lm_eval/tasks/global_piqa/completions/acq_arab.yaml' 2026-02-14T10:26:43,344 adding 'lm_eval/tasks/global_piqa/completions/aeb_arab.yaml' 2026-02-14T10:26:43,345 adding 'lm_eval/tasks/global_piqa/completions/afb_arab.yaml' 2026-02-14T10:26:43,346 adding 'lm_eval/tasks/global_piqa/completions/als_latn.yaml' 2026-02-14T10:26:43,347 adding 'lm_eval/tasks/global_piqa/completions/amh_ethi.yaml' 2026-02-14T10:26:43,348 adding 'lm_eval/tasks/global_piqa/completions/apc_arab_jord.yaml' 2026-02-14T10:26:43,350 adding 'lm_eval/tasks/global_piqa/completions/apc_arab_leba.yaml' 2026-02-14T10:26:43,351 adding 'lm_eval/tasks/global_piqa/completions/apc_arab_pale.yaml' 2026-02-14T10:26:43,352 adding 'lm_eval/tasks/global_piqa/completions/apc_arab_syri.yaml' 2026-02-14T10:26:43,353 adding 'lm_eval/tasks/global_piqa/completions/arb_arab.yaml' 2026-02-14T10:26:43,354 adding 'lm_eval/tasks/global_piqa/completions/arq_arab.yaml' 2026-02-14T10:26:43,355 adding 'lm_eval/tasks/global_piqa/completions/ars_arab.yaml' 2026-02-14T10:26:43,356 adding 'lm_eval/tasks/global_piqa/completions/ary_arab.yaml' 2026-02-14T10:26:43,357 adding 'lm_eval/tasks/global_piqa/completions/arz_arab.yaml' 2026-02-14T10:26:43,358 adding 'lm_eval/tasks/global_piqa/completions/asm_beng.yaml' 2026-02-14T10:26:43,359 adding 'lm_eval/tasks/global_piqa/completions/azj_latn.yaml' 2026-02-14T10:26:43,361 adding 'lm_eval/tasks/global_piqa/completions/bam_latn.yaml' 2026-02-14T10:26:43,362 adding 'lm_eval/tasks/global_piqa/completions/bel_cyrl.yaml' 2026-02-14T10:26:43,363 adding 'lm_eval/tasks/global_piqa/completions/ben_beng.yaml' 2026-02-14T10:26:43,364 adding 'lm_eval/tasks/global_piqa/completions/ben_latn.yaml' 2026-02-14T10:26:43,366 adding 'lm_eval/tasks/global_piqa/completions/bho_deva.yaml' 2026-02-14T10:26:43,367 adding 'lm_eval/tasks/global_piqa/completions/bos_latn.yaml' 2026-02-14T10:26:43,368 adding 'lm_eval/tasks/global_piqa/completions/bsk_arab.yaml' 2026-02-14T10:26:43,369 adding 'lm_eval/tasks/global_piqa/completions/bul_cyrl.yaml' 2026-02-14T10:26:43,370 adding 'lm_eval/tasks/global_piqa/completions/cat_latn.yaml' 2026-02-14T10:26:43,371 adding 'lm_eval/tasks/global_piqa/completions/ces_latn.yaml' 2026-02-14T10:26:43,373 adding 'lm_eval/tasks/global_piqa/completions/ckb_arab.yaml' 2026-02-14T10:26:43,374 adding 'lm_eval/tasks/global_piqa/completions/ckm_latn.yaml' 2026-02-14T10:26:43,375 adding 'lm_eval/tasks/global_piqa/completions/cmn_hans.yaml' 2026-02-14T10:26:43,377 adding 'lm_eval/tasks/global_piqa/completions/cmn_hant.yaml' 2026-02-14T10:26:43,378 adding 'lm_eval/tasks/global_piqa/completions/deu_latn.yaml' 2026-02-14T10:26:43,379 adding 'lm_eval/tasks/global_piqa/completions/dhd_deva.yaml' 2026-02-14T10:26:43,380 adding 'lm_eval/tasks/global_piqa/completions/ekk_latn.yaml' 2026-02-14T10:26:43,381 adding 'lm_eval/tasks/global_piqa/completions/ekp_latn.yaml' 2026-02-14T10:26:43,382 adding 'lm_eval/tasks/global_piqa/completions/ell_grek.yaml' 2026-02-14T10:26:43,383 adding 'lm_eval/tasks/global_piqa/completions/eng_latn.yaml' 2026-02-14T10:26:43,384 adding 'lm_eval/tasks/global_piqa/completions/fao_latn.yaml' 2026-02-14T10:26:43,386 adding 'lm_eval/tasks/global_piqa/completions/fin_latn.yaml' 2026-02-14T10:26:43,387 adding 'lm_eval/tasks/global_piqa/completions/fra_latn_cana.yaml' 2026-02-14T10:26:43,388 adding 'lm_eval/tasks/global_piqa/completions/fra_latn_fran.yaml' 2026-02-14T10:26:43,389 adding 'lm_eval/tasks/global_piqa/completions/glg_latn.yaml' 2026-02-14T10:26:43,390 adding 'lm_eval/tasks/global_piqa/completions/guj_gujr.yaml' 2026-02-14T10:26:43,391 adding 'lm_eval/tasks/global_piqa/completions/hau_latn.yaml' 2026-02-14T10:26:43,392 adding 'lm_eval/tasks/global_piqa/completions/haw_latn.yaml' 2026-02-14T10:26:43,394 adding 'lm_eval/tasks/global_piqa/completions/heb_hebr.yaml' 2026-02-14T10:26:43,395 adding 'lm_eval/tasks/global_piqa/completions/hin_deva.yaml' 2026-02-14T10:26:43,396 adding 'lm_eval/tasks/global_piqa/completions/hrv_latn.yaml' 2026-02-14T10:26:43,397 adding 'lm_eval/tasks/global_piqa/completions/hun_latn.yaml' 2026-02-14T10:26:43,398 adding 'lm_eval/tasks/global_piqa/completions/hye_armn.yaml' 2026-02-14T10:26:43,399 adding 'lm_eval/tasks/global_piqa/completions/ibo_latn.yaml' 2026-02-14T10:26:43,400 adding 'lm_eval/tasks/global_piqa/completions/idu_latn.yaml' 2026-02-14T10:26:43,401 adding 'lm_eval/tasks/global_piqa/completions/ind_latn.yaml' 2026-02-14T10:26:43,402 adding 'lm_eval/tasks/global_piqa/completions/isl_latn.yaml' 2026-02-14T10:26:43,403 adding 'lm_eval/tasks/global_piqa/completions/iso_latn.yaml' 2026-02-14T10:26:43,404 adding 'lm_eval/tasks/global_piqa/completions/ita_latn.yaml' 2026-02-14T10:26:43,406 adding 'lm_eval/tasks/global_piqa/completions/jav_latn.yaml' 2026-02-14T10:26:43,407 adding 'lm_eval/tasks/global_piqa/completions/jpn_jpan.yaml' 2026-02-14T10:26:43,408 adding 'lm_eval/tasks/global_piqa/completions/kan_knda.yaml' 2026-02-14T10:26:43,409 adding 'lm_eval/tasks/global_piqa/completions/kat_geor.yaml' 2026-02-14T10:26:43,410 adding 'lm_eval/tasks/global_piqa/completions/kaz_cyrl.yaml' 2026-02-14T10:26:43,411 adding 'lm_eval/tasks/global_piqa/completions/kin_latn.yaml' 2026-02-14T10:26:43,412 adding 'lm_eval/tasks/global_piqa/completions/kir_cyrl.yaml' 2026-02-14T10:26:43,413 adding 'lm_eval/tasks/global_piqa/completions/kor_hang.yaml' 2026-02-14T10:26:43,414 adding 'lm_eval/tasks/global_piqa/completions/lin_latn.yaml' 2026-02-14T10:26:43,415 adding 'lm_eval/tasks/global_piqa/completions/lit_latn.yaml' 2026-02-14T10:26:43,417 adding 'lm_eval/tasks/global_piqa/completions/luo_latn.yaml' 2026-02-14T10:26:43,418 adding 'lm_eval/tasks/global_piqa/completions/mal_mlym.yaml' 2026-02-14T10:26:43,419 adding 'lm_eval/tasks/global_piqa/completions/mar_deva.yaml' 2026-02-14T10:26:43,420 adding 'lm_eval/tasks/global_piqa/completions/mkd_cyrl.yaml' 2026-02-14T10:26:43,421 adding 'lm_eval/tasks/global_piqa/completions/mni_beng.yaml' 2026-02-14T10:26:43,422 adding 'lm_eval/tasks/global_piqa/completions/mni_mtei.yaml' 2026-02-14T10:26:43,424 adding 'lm_eval/tasks/global_piqa/completions/nag_latn.yaml' 2026-02-14T10:26:43,425 adding 'lm_eval/tasks/global_piqa/completions/nld_latn.yaml' 2026-02-14T10:26:43,426 adding 'lm_eval/tasks/global_piqa/completions/nno_latn.yaml' 2026-02-14T10:26:43,427 adding 'lm_eval/tasks/global_piqa/completions/nob_latn.yaml' 2026-02-14T10:26:43,428 adding 'lm_eval/tasks/global_piqa/completions/npi_deva.yaml' 2026-02-14T10:26:43,429 adding 'lm_eval/tasks/global_piqa/completions/pan_guru.yaml' 2026-02-14T10:26:43,430 adding 'lm_eval/tasks/global_piqa/completions/pcm_latn.yaml' 2026-02-14T10:26:43,432 adding 'lm_eval/tasks/global_piqa/completions/pes_arab.yaml' 2026-02-14T10:26:43,433 adding 'lm_eval/tasks/global_piqa/completions/pol_latn.yaml' 2026-02-14T10:26:43,434 adding 'lm_eval/tasks/global_piqa/completions/por_latn_braz.yaml' 2026-02-14T10:26:43,435 adding 'lm_eval/tasks/global_piqa/completions/por_latn_port.yaml' 2026-02-14T10:26:43,436 adding 'lm_eval/tasks/global_piqa/completions/ron_latn.yaml' 2026-02-14T10:26:43,437 adding 'lm_eval/tasks/global_piqa/completions/rus_cyrl.yaml' 2026-02-14T10:26:43,438 adding 'lm_eval/tasks/global_piqa/completions/rwr_deva.yaml' 2026-02-14T10:26:43,439 adding 'lm_eval/tasks/global_piqa/completions/sin_sinh.yaml' 2026-02-14T10:26:43,441 adding 'lm_eval/tasks/global_piqa/completions/slk_latn.yaml' 2026-02-14T10:26:43,442 adding 'lm_eval/tasks/global_piqa/completions/slk_latn_sari.yaml' 2026-02-14T10:26:43,443 adding 'lm_eval/tasks/global_piqa/completions/slv_latn.yaml' 2026-02-14T10:26:43,444 adding 'lm_eval/tasks/global_piqa/completions/slv_latn_cerk.yaml' 2026-02-14T10:26:43,445 adding 'lm_eval/tasks/global_piqa/completions/snd_arab.yaml' 2026-02-14T10:26:43,446 adding 'lm_eval/tasks/global_piqa/completions/snd_deva.yaml' 2026-02-14T10:26:43,447 adding 'lm_eval/tasks/global_piqa/completions/spa_latn_mexi.yaml' 2026-02-14T10:26:43,448 adding 'lm_eval/tasks/global_piqa/completions/spa_latn_peru.yaml' 2026-02-14T10:26:43,449 adding 'lm_eval/tasks/global_piqa/completions/spa_latn_spai.yaml' 2026-02-14T10:26:43,450 adding 'lm_eval/tasks/global_piqa/completions/srp_cyrl.yaml' 2026-02-14T10:26:43,451 adding 'lm_eval/tasks/global_piqa/completions/srp_latn.yaml' 2026-02-14T10:26:43,452 adding 'lm_eval/tasks/global_piqa/completions/swe_latn.yaml' 2026-02-14T10:26:43,453 adding 'lm_eval/tasks/global_piqa/completions/swh_latn.yaml' 2026-02-14T10:26:43,454 adding 'lm_eval/tasks/global_piqa/completions/tam_taml.yaml' 2026-02-14T10:26:43,455 adding 'lm_eval/tasks/global_piqa/completions/tel_telu.yaml' 2026-02-14T10:26:43,456 adding 'lm_eval/tasks/global_piqa/completions/tgl_latn.yaml' 2026-02-14T10:26:43,458 adding 'lm_eval/tasks/global_piqa/completions/tha_thai.yaml' 2026-02-14T10:26:43,459 adding 'lm_eval/tasks/global_piqa/completions/tur_latn.yaml' 2026-02-14T10:26:43,460 adding 'lm_eval/tasks/global_piqa/completions/uig_arab.yaml' 2026-02-14T10:26:43,461 adding 'lm_eval/tasks/global_piqa/completions/ukr_cyrl.yaml' 2026-02-14T10:26:43,462 adding 'lm_eval/tasks/global_piqa/completions/urd_arab.yaml' 2026-02-14T10:26:43,463 adding 'lm_eval/tasks/global_piqa/completions/urd_latn.yaml' 2026-02-14T10:26:43,464 adding 'lm_eval/tasks/global_piqa/completions/urh_latn.yaml' 2026-02-14T10:26:43,465 adding 'lm_eval/tasks/global_piqa/completions/uzn_latn.yaml' 2026-02-14T10:26:43,466 adding 'lm_eval/tasks/global_piqa/completions/vie_latn.yaml' 2026-02-14T10:26:43,467 adding 'lm_eval/tasks/global_piqa/completions/yor_latn.yaml' 2026-02-14T10:26:43,469 adding 'lm_eval/tasks/global_piqa/completions/yue_hant.yaml' 2026-02-14T10:26:43,470 adding 'lm_eval/tasks/global_piqa/completions/zsm_latn.yaml' 2026-02-14T10:26:43,471 adding 'lm_eval/tasks/global_piqa/completions/zul_latn.yaml' 2026-02-14T10:26:43,475 adding 'lm_eval/tasks/global_piqa/prompted/_generate_config.py' 2026-02-14T10:26:43,476 adding 'lm_eval/tasks/global_piqa/prompted/_global_piqa.yaml' 2026-02-14T10:26:43,478 adding 'lm_eval/tasks/global_piqa/prompted/_template' 2026-02-14T10:26:43,479 adding 'lm_eval/tasks/global_piqa/prompted/acm_arab.yaml' 2026-02-14T10:26:43,480 adding 'lm_eval/tasks/global_piqa/prompted/acq_arab.yaml' 2026-02-14T10:26:43,481 adding 'lm_eval/tasks/global_piqa/prompted/aeb_arab.yaml' 2026-02-14T10:26:43,482 adding 'lm_eval/tasks/global_piqa/prompted/afb_arab.yaml' 2026-02-14T10:26:43,483 adding 'lm_eval/tasks/global_piqa/prompted/als_latn.yaml' 2026-02-14T10:26:43,485 adding 'lm_eval/tasks/global_piqa/prompted/amh_ethi.yaml' 2026-02-14T10:26:43,486 adding 'lm_eval/tasks/global_piqa/prompted/apc_arab_jord.yaml' 2026-02-14T10:26:43,487 adding 'lm_eval/tasks/global_piqa/prompted/apc_arab_leba.yaml' 2026-02-14T10:26:43,488 adding 'lm_eval/tasks/global_piqa/prompted/apc_arab_pale.yaml' 2026-02-14T10:26:43,490 adding 'lm_eval/tasks/global_piqa/prompted/apc_arab_syri.yaml' 2026-02-14T10:26:43,491 adding 'lm_eval/tasks/global_piqa/prompted/arb_arab.yaml' 2026-02-14T10:26:43,492 adding 'lm_eval/tasks/global_piqa/prompted/arq_arab.yaml' 2026-02-14T10:26:43,493 adding 'lm_eval/tasks/global_piqa/prompted/ars_arab.yaml' 2026-02-14T10:26:43,494 adding 'lm_eval/tasks/global_piqa/prompted/ary_arab.yaml' 2026-02-14T10:26:43,495 adding 'lm_eval/tasks/global_piqa/prompted/arz_arab.yaml' 2026-02-14T10:26:43,497 adding 'lm_eval/tasks/global_piqa/prompted/asm_beng.yaml' 2026-02-14T10:26:43,498 adding 'lm_eval/tasks/global_piqa/prompted/azj_latn.yaml' 2026-02-14T10:26:43,499 adding 'lm_eval/tasks/global_piqa/prompted/bam_latn.yaml' 2026-02-14T10:26:43,500 adding 'lm_eval/tasks/global_piqa/prompted/bel_cyrl.yaml' 2026-02-14T10:26:43,501 adding 'lm_eval/tasks/global_piqa/prompted/ben_beng.yaml' 2026-02-14T10:26:43,503 adding 'lm_eval/tasks/global_piqa/prompted/ben_latn.yaml' 2026-02-14T10:26:43,504 adding 'lm_eval/tasks/global_piqa/prompted/bho_deva.yaml' 2026-02-14T10:26:43,505 adding 'lm_eval/tasks/global_piqa/prompted/bos_latn.yaml' 2026-02-14T10:26:43,506 adding 'lm_eval/tasks/global_piqa/prompted/bsk_arab.yaml' 2026-02-14T10:26:43,507 adding 'lm_eval/tasks/global_piqa/prompted/bul_cyrl.yaml' 2026-02-14T10:26:43,508 adding 'lm_eval/tasks/global_piqa/prompted/cat_latn.yaml' 2026-02-14T10:26:43,510 adding 'lm_eval/tasks/global_piqa/prompted/ces_latn.yaml' 2026-02-14T10:26:43,511 adding 'lm_eval/tasks/global_piqa/prompted/ckb_arab.yaml' 2026-02-14T10:26:43,512 adding 'lm_eval/tasks/global_piqa/prompted/ckm_latn.yaml' 2026-02-14T10:26:43,513 adding 'lm_eval/tasks/global_piqa/prompted/cmn_hans.yaml' 2026-02-14T10:26:43,514 adding 'lm_eval/tasks/global_piqa/prompted/cmn_hant.yaml' 2026-02-14T10:26:43,515 adding 'lm_eval/tasks/global_piqa/prompted/deu_latn.yaml' 2026-02-14T10:26:43,516 adding 'lm_eval/tasks/global_piqa/prompted/dhd_deva.yaml' 2026-02-14T10:26:43,517 adding 'lm_eval/tasks/global_piqa/prompted/ekk_latn.yaml' 2026-02-14T10:26:43,518 adding 'lm_eval/tasks/global_piqa/prompted/ekp_latn.yaml' 2026-02-14T10:26:43,520 adding 'lm_eval/tasks/global_piqa/prompted/ell_grek.yaml' 2026-02-14T10:26:43,521 adding 'lm_eval/tasks/global_piqa/prompted/eng_latn.yaml' 2026-02-14T10:26:43,522 adding 'lm_eval/tasks/global_piqa/prompted/fao_latn.yaml' 2026-02-14T10:26:43,523 adding 'lm_eval/tasks/global_piqa/prompted/fin_latn.yaml' 2026-02-14T10:26:43,524 adding 'lm_eval/tasks/global_piqa/prompted/fra_latn_cana.yaml' 2026-02-14T10:26:43,525 adding 'lm_eval/tasks/global_piqa/prompted/fra_latn_fran.yaml' 2026-02-14T10:26:43,526 adding 'lm_eval/tasks/global_piqa/prompted/glg_latn.yaml' 2026-02-14T10:26:43,528 adding 'lm_eval/tasks/global_piqa/prompted/guj_gujr.yaml' 2026-02-14T10:26:43,529 adding 'lm_eval/tasks/global_piqa/prompted/hau_latn.yaml' 2026-02-14T10:26:43,530 adding 'lm_eval/tasks/global_piqa/prompted/haw_latn.yaml' 2026-02-14T10:26:43,531 adding 'lm_eval/tasks/global_piqa/prompted/heb_hebr.yaml' 2026-02-14T10:26:43,532 adding 'lm_eval/tasks/global_piqa/prompted/hin_deva.yaml' 2026-02-14T10:26:43,533 adding 'lm_eval/tasks/global_piqa/prompted/hrv_latn.yaml' 2026-02-14T10:26:43,534 adding 'lm_eval/tasks/global_piqa/prompted/hun_latn.yaml' 2026-02-14T10:26:43,536 adding 'lm_eval/tasks/global_piqa/prompted/hye_armn.yaml' 2026-02-14T10:26:43,537 adding 'lm_eval/tasks/global_piqa/prompted/ibo_latn.yaml' 2026-02-14T10:26:43,538 adding 'lm_eval/tasks/global_piqa/prompted/idu_latn.yaml' 2026-02-14T10:26:43,539 adding 'lm_eval/tasks/global_piqa/prompted/ind_latn.yaml' 2026-02-14T10:26:43,541 adding 'lm_eval/tasks/global_piqa/prompted/isl_latn.yaml' 2026-02-14T10:26:43,542 adding 'lm_eval/tasks/global_piqa/prompted/iso_latn.yaml' 2026-02-14T10:26:43,543 adding 'lm_eval/tasks/global_piqa/prompted/ita_latn.yaml' 2026-02-14T10:26:43,544 adding 'lm_eval/tasks/global_piqa/prompted/jav_latn.yaml' 2026-02-14T10:26:43,546 adding 'lm_eval/tasks/global_piqa/prompted/jpn_jpan.yaml' 2026-02-14T10:26:43,547 adding 'lm_eval/tasks/global_piqa/prompted/kan_knda.yaml' 2026-02-14T10:26:43,548 adding 'lm_eval/tasks/global_piqa/prompted/kat_geor.yaml' 2026-02-14T10:26:43,550 adding 'lm_eval/tasks/global_piqa/prompted/kaz_cyrl.yaml' 2026-02-14T10:26:43,551 adding 'lm_eval/tasks/global_piqa/prompted/kin_latn.yaml' 2026-02-14T10:26:43,552 adding 'lm_eval/tasks/global_piqa/prompted/kir_cyrl.yaml' 2026-02-14T10:26:43,553 adding 'lm_eval/tasks/global_piqa/prompted/kor_hang.yaml' 2026-02-14T10:26:43,554 adding 'lm_eval/tasks/global_piqa/prompted/lin_latn.yaml' 2026-02-14T10:26:43,555 adding 'lm_eval/tasks/global_piqa/prompted/lit_latn.yaml' 2026-02-14T10:26:43,556 adding 'lm_eval/tasks/global_piqa/prompted/luo_latn.yaml' 2026-02-14T10:26:43,557 adding 'lm_eval/tasks/global_piqa/prompted/mal_mlym.yaml' 2026-02-14T10:26:43,558 adding 'lm_eval/tasks/global_piqa/prompted/mar_deva.yaml' 2026-02-14T10:26:43,559 adding 'lm_eval/tasks/global_piqa/prompted/mkd_cyrl.yaml' 2026-02-14T10:26:43,560 adding 'lm_eval/tasks/global_piqa/prompted/mni_beng.yaml' 2026-02-14T10:26:43,561 adding 'lm_eval/tasks/global_piqa/prompted/mni_mtei.yaml' 2026-02-14T10:26:43,562 adding 'lm_eval/tasks/global_piqa/prompted/nag_latn.yaml' 2026-02-14T10:26:43,563 adding 'lm_eval/tasks/global_piqa/prompted/nld_latn.yaml' 2026-02-14T10:26:43,564 adding 'lm_eval/tasks/global_piqa/prompted/nno_latn.yaml' 2026-02-14T10:26:43,566 adding 'lm_eval/tasks/global_piqa/prompted/nob_latn.yaml' 2026-02-14T10:26:43,567 adding 'lm_eval/tasks/global_piqa/prompted/npi_deva.yaml' 2026-02-14T10:26:43,568 adding 'lm_eval/tasks/global_piqa/prompted/pan_guru.yaml' 2026-02-14T10:26:43,569 adding 'lm_eval/tasks/global_piqa/prompted/pcm_latn.yaml' 2026-02-14T10:26:43,570 adding 'lm_eval/tasks/global_piqa/prompted/pes_arab.yaml' 2026-02-14T10:26:43,571 adding 'lm_eval/tasks/global_piqa/prompted/pol_latn.yaml' 2026-02-14T10:26:43,572 adding 'lm_eval/tasks/global_piqa/prompted/por_latn_braz.yaml' 2026-02-14T10:26:43,573 adding 'lm_eval/tasks/global_piqa/prompted/por_latn_port.yaml' 2026-02-14T10:26:43,574 adding 'lm_eval/tasks/global_piqa/prompted/ron_latn.yaml' 2026-02-14T10:26:43,575 adding 'lm_eval/tasks/global_piqa/prompted/rus_cyrl.yaml' 2026-02-14T10:26:43,577 adding 'lm_eval/tasks/global_piqa/prompted/rwr_deva.yaml' 2026-02-14T10:26:43,578 adding 'lm_eval/tasks/global_piqa/prompted/sin_sinh.yaml' 2026-02-14T10:26:43,579 adding 'lm_eval/tasks/global_piqa/prompted/slk_latn.yaml' 2026-02-14T10:26:43,580 adding 'lm_eval/tasks/global_piqa/prompted/slk_latn_sari.yaml' 2026-02-14T10:26:43,581 adding 'lm_eval/tasks/global_piqa/prompted/slv_latn.yaml' 2026-02-14T10:26:43,583 adding 'lm_eval/tasks/global_piqa/prompted/slv_latn_cerk.yaml' 2026-02-14T10:26:43,584 adding 'lm_eval/tasks/global_piqa/prompted/snd_arab.yaml' 2026-02-14T10:26:43,585 adding 'lm_eval/tasks/global_piqa/prompted/snd_deva.yaml' 2026-02-14T10:26:43,587 adding 'lm_eval/tasks/global_piqa/prompted/spa_latn_mexi.yaml' 2026-02-14T10:26:43,588 adding 'lm_eval/tasks/global_piqa/prompted/spa_latn_peru.yaml' 2026-02-14T10:26:43,589 adding 'lm_eval/tasks/global_piqa/prompted/spa_latn_spai.yaml' 2026-02-14T10:26:43,590 adding 'lm_eval/tasks/global_piqa/prompted/srp_cyrl.yaml' 2026-02-14T10:26:43,592 adding 'lm_eval/tasks/global_piqa/prompted/srp_latn.yaml' 2026-02-14T10:26:43,593 adding 'lm_eval/tasks/global_piqa/prompted/swe_latn.yaml' 2026-02-14T10:26:43,594 adding 'lm_eval/tasks/global_piqa/prompted/swh_latn.yaml' 2026-02-14T10:26:43,595 adding 'lm_eval/tasks/global_piqa/prompted/tam_taml.yaml' 2026-02-14T10:26:43,597 adding 'lm_eval/tasks/global_piqa/prompted/tel_telu.yaml' 2026-02-14T10:26:43,598 adding 'lm_eval/tasks/global_piqa/prompted/tgl_latn.yaml' 2026-02-14T10:26:43,599 adding 'lm_eval/tasks/global_piqa/prompted/tha_thai.yaml' 2026-02-14T10:26:43,600 adding 'lm_eval/tasks/global_piqa/prompted/tur_latn.yaml' 2026-02-14T10:26:43,601 adding 'lm_eval/tasks/global_piqa/prompted/uig_arab.yaml' 2026-02-14T10:26:43,603 adding 'lm_eval/tasks/global_piqa/prompted/ukr_cyrl.yaml' 2026-02-14T10:26:43,604 adding 'lm_eval/tasks/global_piqa/prompted/urd_arab.yaml' 2026-02-14T10:26:43,605 adding 'lm_eval/tasks/global_piqa/prompted/urd_latn.yaml' 2026-02-14T10:26:43,606 adding 'lm_eval/tasks/global_piqa/prompted/urh_latn.yaml' 2026-02-14T10:26:43,607 adding 'lm_eval/tasks/global_piqa/prompted/uzn_latn.yaml' 2026-02-14T10:26:43,608 adding 'lm_eval/tasks/global_piqa/prompted/vie_latn.yaml' 2026-02-14T10:26:43,610 adding 'lm_eval/tasks/global_piqa/prompted/yor_latn.yaml' 2026-02-14T10:26:43,611 adding 'lm_eval/tasks/global_piqa/prompted/yue_hant.yaml' 2026-02-14T10:26:43,612 adding 'lm_eval/tasks/global_piqa/prompted/zsm_latn.yaml' 2026-02-14T10:26:43,613 adding 'lm_eval/tasks/global_piqa/prompted/zul_latn.yaml' 2026-02-14T10:26:43,615 adding 'lm_eval/tasks/glue/README.md' 2026-02-14T10:26:43,617 adding 'lm_eval/tasks/glue/cola/default.yaml' 2026-02-14T10:26:43,618 adding 'lm_eval/tasks/glue/mnli/default.yaml' 2026-02-14T10:26:43,619 adding 'lm_eval/tasks/glue/mnli/mismatch.yaml' 2026-02-14T10:26:43,620 adding 'lm_eval/tasks/glue/mnli/utils.py' 2026-02-14T10:26:43,622 adding 'lm_eval/tasks/glue/mrpc/default.yaml' 2026-02-14T10:26:43,624 adding 'lm_eval/tasks/glue/qnli/default.yaml' 2026-02-14T10:26:43,625 adding 'lm_eval/tasks/glue/qqp/default.yaml' 2026-02-14T10:26:43,627 adding 'lm_eval/tasks/glue/rte/default.yaml' 2026-02-14T10:26:43,628 adding 'lm_eval/tasks/glue/sst2/default.yaml' 2026-02-14T10:26:43,630 adding 'lm_eval/tasks/glue/wnli/default.yaml' 2026-02-14T10:26:43,632 adding 'lm_eval/tasks/gpqa/README.md' 2026-02-14T10:26:43,634 adding 'lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py' 2026-02-14T10:26:43,635 adding 'lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml' 2026-02-14T10:26:43,636 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml' 2026-02-14T10:26:43,637 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml' 2026-02-14T10:26:43,638 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml' 2026-02-14T10:26:43,640 adding 'lm_eval/tasks/gpqa/cot_n_shot/utils.py' 2026-02-14T10:26:43,641 adding 'lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py' 2026-02-14T10:26:43,642 adding 'lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml' 2026-02-14T10:26:43,644 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml' 2026-02-14T10:26:43,645 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml' 2026-02-14T10:26:43,646 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml' 2026-02-14T10:26:43,647 adding 'lm_eval/tasks/gpqa/cot_zeroshot/utils.py' 2026-02-14T10:26:43,649 adding 'lm_eval/tasks/gpqa/generative/_generate_configs.py' 2026-02-14T10:26:43,650 adding 'lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml' 2026-02-14T10:26:43,651 adding 'lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml' 2026-02-14T10:26:43,653 adding 'lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml' 2026-02-14T10:26:43,654 adding 'lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml' 2026-02-14T10:26:43,655 adding 'lm_eval/tasks/gpqa/generative/utils.py' 2026-02-14T10:26:43,657 adding 'lm_eval/tasks/gpqa/n_shot/_generate_configs.py' 2026-02-14T10:26:43,658 adding 'lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml' 2026-02-14T10:26:43,659 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml' 2026-02-14T10:26:43,661 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml' 2026-02-14T10:26:43,662 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml' 2026-02-14T10:26:43,663 adding 'lm_eval/tasks/gpqa/n_shot/utils.py' 2026-02-14T10:26:43,665 adding 'lm_eval/tasks/gpqa/zeroshot/_generate_configs.py' 2026-02-14T10:26:43,666 adding 'lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml' 2026-02-14T10:26:43,667 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml' 2026-02-14T10:26:43,669 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml' 2026-02-14T10:26:43,670 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml' 2026-02-14T10:26:43,671 adding 'lm_eval/tasks/gpqa/zeroshot/utils.py' 2026-02-14T10:26:43,673 adding 'lm_eval/tasks/graphwalks/README.md' 2026-02-14T10:26:43,674 adding 'lm_eval/tasks/graphwalks/graphwalks.yaml' 2026-02-14T10:26:43,675 adding 'lm_eval/tasks/graphwalks/graphwalks_128k.yaml' 2026-02-14T10:26:43,677 adding 'lm_eval/tasks/graphwalks/graphwalks_1M.yaml' 2026-02-14T10:26:43,678 adding 'lm_eval/tasks/graphwalks/utils.py' 2026-02-14T10:26:43,680 adding 'lm_eval/tasks/groundcocoa/README.md' 2026-02-14T10:26:43,682 adding 'lm_eval/tasks/groundcocoa/groundcocoa.yaml' 2026-02-14T10:26:43,683 adding 'lm_eval/tasks/groundcocoa/utils.py' 2026-02-14T10:26:43,685 adding 'lm_eval/tasks/gsm8k/README.md' 2026-02-14T10:26:43,686 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml' 2026-02-14T10:26:43,687 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml' 2026-02-14T10:26:43,688 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml' 2026-02-14T10:26:43,690 adding 'lm_eval/tasks/gsm8k/gsm8k-cot.yaml' 2026-02-14T10:26:43,691 adding 'lm_eval/tasks/gsm8k/gsm8k.yaml' 2026-02-14T10:26:43,693 adding 'lm_eval/tasks/gsm8k_platinum/README.md' 2026-02-14T10:26:43,694 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml' 2026-02-14T10:26:43,696 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml' 2026-02-14T10:26:43,697 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml' 2026-02-14T10:26:43,698 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml' 2026-02-14T10:26:43,700 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml' 2026-02-14T10:26:43,701 adding 'lm_eval/tasks/gsm_plus/README.md' 2026-02-14T10:26:43,703 adding 'lm_eval/tasks/gsm_plus/gsm_plus.yaml' 2026-02-14T10:26:43,704 adding 'lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml' 2026-02-14T10:26:43,706 adding 'lm_eval/tasks/haerae/README.md' 2026-02-14T10:26:43,707 adding 'lm_eval/tasks/haerae/_default_haerae_yaml' 2026-02-14T10:26:43,708 adding 'lm_eval/tasks/haerae/_haerae.yaml' 2026-02-14T10:26:43,710 adding 'lm_eval/tasks/haerae/haerae_gk.yaml' 2026-02-14T10:26:43,711 adding 'lm_eval/tasks/haerae/haerae_hi.yaml' 2026-02-14T10:26:43,712 adding 'lm_eval/tasks/haerae/haerae_lw.yaml' 2026-02-14T10:26:43,713 adding 'lm_eval/tasks/haerae/haerae_rw.yaml' 2026-02-14T10:26:43,714 adding 'lm_eval/tasks/haerae/haerae_sn.yaml' 2026-02-14T10:26:43,716 adding 'lm_eval/tasks/headqa/README.md' 2026-02-14T10:26:43,717 adding 'lm_eval/tasks/headqa/headqa_en.yaml' 2026-02-14T10:26:43,719 adding 'lm_eval/tasks/headqa/headqa_es.yaml' 2026-02-14T10:26:43,720 adding 'lm_eval/tasks/hellaswag/README.md' 2026-02-14T10:26:43,722 adding 'lm_eval/tasks/hellaswag/hellaswag.yaml' 2026-02-14T10:26:43,723 adding 'lm_eval/tasks/hellaswag/utils.py' 2026-02-14T10:26:43,725 adding 'lm_eval/tasks/hendrycks_ethics/README.md' 2026-02-14T10:26:43,726 adding 'lm_eval/tasks/hendrycks_ethics/commonsense.yaml' 2026-02-14T10:26:43,727 adding 'lm_eval/tasks/hendrycks_ethics/deontology.yaml' 2026-02-14T10:26:43,728 adding 'lm_eval/tasks/hendrycks_ethics/justice.yaml' 2026-02-14T10:26:43,729 adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml' 2026-02-14T10:26:43,731 adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml' 2026-02-14T10:26:43,732 adding 'lm_eval/tasks/hendrycks_ethics/utils.py' 2026-02-14T10:26:43,733 adding 'lm_eval/tasks/hendrycks_ethics/virtue.yaml' 2026-02-14T10:26:43,735 adding 'lm_eval/tasks/hendrycks_math/README.md' 2026-02-14T10:26:43,736 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math.yaml' 2026-02-14T10:26:43,738 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml' 2026-02-14T10:26:43,739 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml' 2026-02-14T10:26:43,740 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml' 2026-02-14T10:26:43,741 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml' 2026-02-14T10:26:43,742 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml' 2026-02-14T10:26:43,744 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml' 2026-02-14T10:26:43,745 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml' 2026-02-14T10:26:43,746 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml' 2026-02-14T10:26:43,748 adding 'lm_eval/tasks/hendrycks_math/utils.py' 2026-02-14T10:26:43,750 adding 'lm_eval/tasks/histoires_morales/README.md' 2026-02-14T10:26:43,751 adding 'lm_eval/tasks/histoires_morales/histoires_morales.yaml' 2026-02-14T10:26:43,752 adding 'lm_eval/tasks/histoires_morales/utils.py' 2026-02-14T10:26:43,754 adding 'lm_eval/tasks/hrm8k/README.md' 2026-02-14T10:26:43,756 adding 'lm_eval/tasks/hrm8k/default/_hrm8k_yaml' 2026-02-14T10:26:43,757 adding 'lm_eval/tasks/hrm8k/default/hrm8k.yaml' 2026-02-14T10:26:43,758 adding 'lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml' 2026-02-14T10:26:43,759 adding 'lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml' 2026-02-14T10:26:43,761 adding 'lm_eval/tasks/hrm8k/default/hrm8k_math.yaml' 2026-02-14T10:26:43,762 adding 'lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml' 2026-02-14T10:26:43,763 adding 'lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml' 2026-02-14T10:26:43,764 adding 'lm_eval/tasks/hrm8k/default/utils.py' 2026-02-14T10:26:43,766 adding 'lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml' 2026-02-14T10:26:43,767 adding 'lm_eval/tasks/hrm8k/en/hrm8k_en.yaml' 2026-02-14T10:26:43,769 adding 'lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml' 2026-02-14T10:26:43,770 adding 'lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml' 2026-02-14T10:26:43,771 adding 'lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml' 2026-02-14T10:26:43,772 adding 'lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml' 2026-02-14T10:26:43,773 adding 'lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml' 2026-02-14T10:26:43,775 adding 'lm_eval/tasks/hrm8k/en/utils.py' 2026-02-14T10:26:43,777 adding 'lm_eval/tasks/humaneval/README.md' 2026-02-14T10:26:43,778 adding 'lm_eval/tasks/humaneval/humaneval.yaml' 2026-02-14T10:26:43,780 adding 'lm_eval/tasks/humaneval/humaneval_64.yaml' 2026-02-14T10:26:43,781 adding 'lm_eval/tasks/humaneval/humaneval_64_instruct.yaml' 2026-02-14T10:26:43,782 adding 'lm_eval/tasks/humaneval/humaneval_instruct.yaml' 2026-02-14T10:26:43,783 adding 'lm_eval/tasks/humaneval/humaneval_plus.yaml' 2026-02-14T10:26:43,784 adding 'lm_eval/tasks/humaneval/utils.py' 2026-02-14T10:26:43,786 adding 'lm_eval/tasks/humaneval_infilling/README.md' 2026-02-14T10:26:43,787 adding 'lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml' 2026-02-14T10:26:43,789 adding 'lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml' 2026-02-14T10:26:43,790 adding 'lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml' 2026-02-14T10:26:43,791 adding 'lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml' 2026-02-14T10:26:43,792 adding 'lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml' 2026-02-14T10:26:43,793 adding 'lm_eval/tasks/humaneval_infilling/utils.py' 2026-02-14T10:26:43,795 adding 'lm_eval/tasks/icelandic_winogrande/README.md' 2026-02-14T10:26:43,797 adding 'lm_eval/tasks/icelandic_winogrande/default.yaml' 2026-02-14T10:26:43,798 adding 'lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py' 2026-02-14T10:26:43,800 adding 'lm_eval/tasks/ifeval/README.md' 2026-02-14T10:26:43,801 adding 'lm_eval/tasks/ifeval/ifeval.yaml' 2026-02-14T10:26:43,806 adding 'lm_eval/tasks/ifeval/instructions.py' 2026-02-14T10:26:43,808 adding 'lm_eval/tasks/ifeval/instructions_registry.py' 2026-02-14T10:26:43,812 adding 'lm_eval/tasks/ifeval/instructions_util.py' 2026-02-14T10:26:43,813 adding 'lm_eval/tasks/ifeval/utils.py' 2026-02-14T10:26:43,815 adding 'lm_eval/tasks/ifeval/multilingual/ifeval_ca.yaml' 2026-02-14T10:26:43,816 adding 'lm_eval/tasks/ifeval/multilingual/ifeval_es.yaml' 2026-02-14T10:26:43,818 adding 'lm_eval/tasks/ifeval/multilingual/instructions_registry.py' 2026-02-14T10:26:43,819 adding 'lm_eval/tasks/ifeval/multilingual/utils.py' 2026-02-14T10:26:43,821 adding 'lm_eval/tasks/ifeval/multilingual/instruction_utils/__init__.py' 2026-02-14T10:26:43,822 adding 'lm_eval/tasks/ifeval/multilingual/instruction_utils/ca_instructions_util.py' 2026-02-14T10:26:43,824 adding 'lm_eval/tasks/ifeval/multilingual/instruction_utils/es_instructions_util.py' 2026-02-14T10:26:43,825 adding 'lm_eval/tasks/ifeval/multilingual/instructions/__init__.py' 2026-02-14T10:26:43,832 adding 'lm_eval/tasks/ifeval/multilingual/instructions/ca_instructions.py' 2026-02-14T10:26:43,838 adding 'lm_eval/tasks/ifeval/multilingual/instructions/es_instructions.py' 2026-02-14T10:26:43,841 adding 'lm_eval/tasks/include/README.md' 2026-02-14T10:26:43,844 adding 'lm_eval/tasks/include/default/Albanian/_albanian_template_yaml' 2026-02-14T10:26:43,845 adding 'lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml' 2026-02-14T10:26:43,846 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml' 2026-02-14T10:26:43,847 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml' 2026-02-14T10:26:43,848 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2026-02-14T10:26:43,849 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml' 2026-02-14T10:26:43,850 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml' 2026-02-14T10:26:43,851 adding 'lm_eval/tasks/include/default/Albanian/utils.py' 2026-02-14T10:26:43,853 adding 'lm_eval/tasks/include/default/Arabic/_arabic_template_yaml' 2026-02-14T10:26:43,854 adding 'lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml' 2026-02-14T10:26:43,855 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml' 2026-02-14T10:26:43,856 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml' 2026-02-14T10:26:43,857 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml' 2026-02-14T10:26:43,858 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml' 2026-02-14T10:26:43,860 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml' 2026-02-14T10:26:43,861 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml' 2026-02-14T10:26:43,862 adding 'lm_eval/tasks/include/default/Arabic/utils.py' 2026-02-14T10:26:43,864 adding 'lm_eval/tasks/include/default/Armenian/_armenian_template_yaml' 2026-02-14T10:26:43,865 adding 'lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml' 2026-02-14T10:26:43,866 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml' 2026-02-14T10:26:43,867 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml' 2026-02-14T10:26:43,868 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml' 2026-02-14T10:26:43,870 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml' 2026-02-14T10:26:43,871 adding 'lm_eval/tasks/include/default/Armenian/utils.py' 2026-02-14T10:26:43,873 adding 'lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml' 2026-02-14T10:26:43,874 adding 'lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml' 2026-02-14T10:26:43,875 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2026-02-14T10:26:43,876 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2026-02-14T10:26:43,878 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2026-02-14T10:26:43,879 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2026-02-14T10:26:43,880 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2026-02-14T10:26:43,881 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2026-02-14T10:26:43,883 adding 'lm_eval/tasks/include/default/Azerbaijani/utils.py' 2026-02-14T10:26:43,884 adding 'lm_eval/tasks/include/default/Basque/_basque_template_yaml' 2026-02-14T10:26:43,886 adding 'lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml' 2026-02-14T10:26:43,887 adding 'lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml' 2026-02-14T10:26:43,888 adding 'lm_eval/tasks/include/default/Basque/utils.py' 2026-02-14T10:26:43,890 adding 'lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml' 2026-02-14T10:26:43,891 adding 'lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml' 2026-02-14T10:26:43,892 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2026-02-14T10:26:43,893 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml' 2026-02-14T10:26:43,894 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml' 2026-02-14T10:26:43,895 adding 'lm_eval/tasks/include/default/Belarusian/utils.py' 2026-02-14T10:26:43,897 adding 'lm_eval/tasks/include/default/Bengali/_bengali_template_yaml' 2026-02-14T10:26:43,898 adding 'lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml' 2026-02-14T10:26:43,899 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml' 2026-02-14T10:26:43,901 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml' 2026-02-14T10:26:43,902 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml' 2026-02-14T10:26:43,903 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml' 2026-02-14T10:26:43,904 adding 'lm_eval/tasks/include/default/Bengali/utils.py' 2026-02-14T10:26:43,906 adding 'lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml' 2026-02-14T10:26:43,907 adding 'lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml' 2026-02-14T10:26:43,908 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2026-02-14T10:26:43,909 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2026-02-14T10:26:43,911 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml' 2026-02-14T10:26:43,912 adding 'lm_eval/tasks/include/default/Bulgarian/utils.py' 2026-02-14T10:26:43,914 adding 'lm_eval/tasks/include/default/Chinese/_chinese_template_yaml' 2026-02-14T10:26:43,915 adding 'lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml' 2026-02-14T10:26:43,916 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml' 2026-02-14T10:26:43,917 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml' 2026-02-14T10:26:43,918 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml' 2026-02-14T10:26:43,920 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml' 2026-02-14T10:26:43,921 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2026-02-14T10:26:43,922 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml' 2026-02-14T10:26:43,923 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml' 2026-02-14T10:26:43,924 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml' 2026-02-14T10:26:43,926 adding 'lm_eval/tasks/include/default/Chinese/utils.py' 2026-02-14T10:26:43,928 adding 'lm_eval/tasks/include/default/Croatian/_croatian_template_yaml' 2026-02-14T10:26:43,929 adding 'lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml' 2026-02-14T10:26:43,930 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml' 2026-02-14T10:26:43,931 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml' 2026-02-14T10:26:43,932 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml' 2026-02-14T10:26:43,934 adding 'lm_eval/tasks/include/default/Croatian/utils.py' 2026-02-14T10:26:43,936 adding 'lm_eval/tasks/include/default/Dutch/_dutch_template_yaml' 2026-02-14T10:26:43,937 adding 'lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml' 2026-02-14T10:26:43,938 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml' 2026-02-14T10:26:43,939 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml' 2026-02-14T10:26:43,940 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2026-02-14T10:26:43,941 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml' 2026-02-14T10:26:43,942 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml' 2026-02-14T10:26:43,944 adding 'lm_eval/tasks/include/default/Dutch/utils.py' 2026-02-14T10:26:43,946 adding 'lm_eval/tasks/include/default/Estonian/_estonian_template_yaml' 2026-02-14T10:26:43,947 adding 'lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml' 2026-02-14T10:26:43,948 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml' 2026-02-14T10:26:43,949 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml' 2026-02-14T10:26:43,950 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2026-02-14T10:26:43,951 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml' 2026-02-14T10:26:43,953 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml' 2026-02-14T10:26:43,954 adding 'lm_eval/tasks/include/default/Estonian/utils.py' 2026-02-14T10:26:43,956 adding 'lm_eval/tasks/include/default/Finnish/_finnish_template_yaml' 2026-02-14T10:26:43,957 adding 'lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml' 2026-02-14T10:26:43,958 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml' 2026-02-14T10:26:43,959 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml' 2026-02-14T10:26:43,961 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2026-02-14T10:26:43,962 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml' 2026-02-14T10:26:43,963 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml' 2026-02-14T10:26:43,965 adding 'lm_eval/tasks/include/default/Finnish/utils.py' 2026-02-14T10:26:43,967 adding 'lm_eval/tasks/include/default/French/_french_template_yaml' 2026-02-14T10:26:43,968 adding 'lm_eval/tasks/include/default/French/_include_base_44_french.yaml' 2026-02-14T10:26:43,969 adding 'lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml' 2026-02-14T10:26:43,970 adding 'lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml' 2026-02-14T10:26:43,972 adding 'lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml' 2026-02-14T10:26:43,973 adding 'lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml' 2026-02-14T10:26:43,974 adding 'lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml' 2026-02-14T10:26:43,975 adding 'lm_eval/tasks/include/default/French/utils.py' 2026-02-14T10:26:43,977 adding 'lm_eval/tasks/include/default/Georgian/_georgian_template_yaml' 2026-02-14T10:26:43,979 adding 'lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml' 2026-02-14T10:26:43,980 adding 'lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml' 2026-02-14T10:26:43,981 adding 'lm_eval/tasks/include/default/Georgian/utils.py' 2026-02-14T10:26:43,983 adding 'lm_eval/tasks/include/default/German/_german_template_yaml' 2026-02-14T10:26:43,984 adding 'lm_eval/tasks/include/default/German/_include_base_44_german.yaml' 2026-02-14T10:26:43,985 adding 'lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml' 2026-02-14T10:26:43,987 adding 'lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml' 2026-02-14T10:26:43,988 adding 'lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml' 2026-02-14T10:26:43,989 adding 'lm_eval/tasks/include/default/German/utils.py' 2026-02-14T10:26:43,991 adding 'lm_eval/tasks/include/default/Greek/_greek_template_yaml' 2026-02-14T10:26:43,992 adding 'lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml' 2026-02-14T10:26:43,993 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml' 2026-02-14T10:26:43,994 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml' 2026-02-14T10:26:43,995 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml' 2026-02-14T10:26:43,996 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml' 2026-02-14T10:26:43,997 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml' 2026-02-14T10:26:43,999 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml' 2026-02-14T10:26:44,000 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml' 2026-02-14T10:26:44,001 adding 'lm_eval/tasks/include/default/Greek/utils.py' 2026-02-14T10:26:44,003 adding 'lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml' 2026-02-14T10:26:44,004 adding 'lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml' 2026-02-14T10:26:44,005 adding 'lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2026-02-14T10:26:44,006 adding 'lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml' 2026-02-14T10:26:44,008 adding 'lm_eval/tasks/include/default/Hebrew/utils.py' 2026-02-14T10:26:44,009 adding 'lm_eval/tasks/include/default/Hindi/_hindi_template_yaml' 2026-02-14T10:26:44,011 adding 'lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml' 2026-02-14T10:26:44,012 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml' 2026-02-14T10:26:44,013 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml' 2026-02-14T10:26:44,014 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml' 2026-02-14T10:26:44,015 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml' 2026-02-14T10:26:44,016 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2026-02-14T10:26:44,018 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml' 2026-02-14T10:26:44,019 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml' 2026-02-14T10:26:44,020 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml' 2026-02-14T10:26:44,021 adding 'lm_eval/tasks/include/default/Hindi/utils.py' 2026-02-14T10:26:44,023 adding 'lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml' 2026-02-14T10:26:44,024 adding 'lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml' 2026-02-14T10:26:44,025 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml' 2026-02-14T10:26:44,026 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml' 2026-02-14T10:26:44,028 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml' 2026-02-14T10:26:44,029 adding 'lm_eval/tasks/include/default/Hungarian/utils.py' 2026-02-14T10:26:44,030 adding 'lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml' 2026-02-14T10:26:44,032 adding 'lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml' 2026-02-14T10:26:44,033 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml' 2026-02-14T10:26:44,034 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2026-02-14T10:26:44,035 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2026-02-14T10:26:44,036 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml' 2026-02-14T10:26:44,037 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml' 2026-02-14T10:26:44,038 adding 'lm_eval/tasks/include/default/Indonesian/utils.py' 2026-02-14T10:26:44,040 adding 'lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml' 2026-02-14T10:26:44,041 adding 'lm_eval/tasks/include/default/Italian/_italian_template_yaml' 2026-02-14T10:26:44,042 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml' 2026-02-14T10:26:44,044 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml' 2026-02-14T10:26:44,045 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml' 2026-02-14T10:26:44,046 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml' 2026-02-14T10:26:44,047 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml' 2026-02-14T10:26:44,048 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml' 2026-02-14T10:26:44,050 adding 'lm_eval/tasks/include/default/Italian/utils.py' 2026-02-14T10:26:44,051 adding 'lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml' 2026-02-14T10:26:44,052 adding 'lm_eval/tasks/include/default/Japanese/_japanese_template_yaml' 2026-02-14T10:26:44,053 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml' 2026-02-14T10:26:44,055 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml' 2026-02-14T10:26:44,056 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml' 2026-02-14T10:26:44,057 adding 'lm_eval/tasks/include/default/Japanese/utils.py' 2026-02-14T10:26:44,059 adding 'lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml' 2026-02-14T10:26:44,060 adding 'lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml' 2026-02-14T10:26:44,061 adding 'lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2026-02-14T10:26:44,062 adding 'lm_eval/tasks/include/default/Kazakh/utils.py' 2026-02-14T10:26:44,064 adding 'lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml' 2026-02-14T10:26:44,065 adding 'lm_eval/tasks/include/default/Korean/_korean_template_yaml' 2026-02-14T10:26:44,066 adding 'lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml' 2026-02-14T10:26:44,068 adding 'lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml' 2026-02-14T10:26:44,069 adding 'lm_eval/tasks/include/default/Korean/utils.py' 2026-02-14T10:26:44,071 adding 'lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml' 2026-02-14T10:26:44,072 adding 'lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml' 2026-02-14T10:26:44,073 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2026-02-14T10:26:44,074 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2026-02-14T10:26:44,075 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2026-02-14T10:26:44,077 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2026-02-14T10:26:44,078 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml' 2026-02-14T10:26:44,079 adding 'lm_eval/tasks/include/default/Lithuanian/utils.py' 2026-02-14T10:26:44,081 adding 'lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml' 2026-02-14T10:26:44,082 adding 'lm_eval/tasks/include/default/Malay/_malay_template_yaml' 2026-02-14T10:26:44,083 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml' 2026-02-14T10:26:44,084 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml' 2026-02-14T10:26:44,085 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml' 2026-02-14T10:26:44,086 adding 'lm_eval/tasks/include/default/Malay/utils.py' 2026-02-14T10:26:44,088 adding 'lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml' 2026-02-14T10:26:44,089 adding 'lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml' 2026-02-14T10:26:44,090 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2026-02-14T10:26:44,091 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2026-02-14T10:26:44,092 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2026-02-14T10:26:44,094 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml' 2026-02-14T10:26:44,095 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml' 2026-02-14T10:26:44,096 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml' 2026-02-14T10:26:44,097 adding 'lm_eval/tasks/include/default/Malayalam/utils.py' 2026-02-14T10:26:44,099 adding 'lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml' 2026-02-14T10:26:44,100 adding 'lm_eval/tasks/include/default/Nepali/_nepali_template_yaml' 2026-02-14T10:26:44,101 adding 'lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml' 2026-02-14T10:26:44,102 adding 'lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml' 2026-02-14T10:26:44,104 adding 'lm_eval/tasks/include/default/Nepali/utils.py' 2026-02-14T10:26:44,105 adding 'lm_eval/tasks/include/default/North Macedonian/_include_base_44_north macedonian.yaml' 2026-02-14T10:26:44,106 adding 'lm_eval/tasks/include/default/North Macedonian/_north macedonian_template_yaml' 2026-02-14T10:26:44,108 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml' 2026-02-14T10:26:44,109 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_business_commerce.yaml' 2026-02-14T10:26:44,110 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_social_science.yaml' 2026-02-14T10:26:44,111 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_stem.yaml' 2026-02-14T10:26:44,112 adding 'lm_eval/tasks/include/default/North Macedonian/utils.py' 2026-02-14T10:26:44,114 adding 'lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml' 2026-02-14T10:26:44,115 adding 'lm_eval/tasks/include/default/Persian/_persian_template_yaml' 2026-02-14T10:26:44,117 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml' 2026-02-14T10:26:44,118 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml' 2026-02-14T10:26:44,119 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml' 2026-02-14T10:26:44,120 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml' 2026-02-14T10:26:44,121 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml' 2026-02-14T10:26:44,122 adding 'lm_eval/tasks/include/default/Persian/utils.py' 2026-02-14T10:26:44,124 adding 'lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml' 2026-02-14T10:26:44,126 adding 'lm_eval/tasks/include/default/Polish/_polish_template_yaml' 2026-02-14T10:26:44,127 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml' 2026-02-14T10:26:44,128 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml' 2026-02-14T10:26:44,129 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml' 2026-02-14T10:26:44,130 adding 'lm_eval/tasks/include/default/Polish/utils.py' 2026-02-14T10:26:44,132 adding 'lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml' 2026-02-14T10:26:44,133 adding 'lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml' 2026-02-14T10:26:44,134 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml' 2026-02-14T10:26:44,135 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2026-02-14T10:26:44,136 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2026-02-14T10:26:44,137 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2026-02-14T10:26:44,139 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml' 2026-02-14T10:26:44,140 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml' 2026-02-14T10:26:44,141 adding 'lm_eval/tasks/include/default/Portuguese/utils.py' 2026-02-14T10:26:44,143 adding 'lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml' 2026-02-14T10:26:44,144 adding 'lm_eval/tasks/include/default/Russian/_russian_template_yaml' 2026-02-14T10:26:44,145 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml' 2026-02-14T10:26:44,146 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml' 2026-02-14T10:26:44,148 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml' 2026-02-14T10:26:44,149 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml' 2026-02-14T10:26:44,150 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml' 2026-02-14T10:26:44,151 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml' 2026-02-14T10:26:44,152 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml' 2026-02-14T10:26:44,153 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml' 2026-02-14T10:26:44,155 adding 'lm_eval/tasks/include/default/Russian/utils.py' 2026-02-14T10:26:44,156 adding 'lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml' 2026-02-14T10:26:44,157 adding 'lm_eval/tasks/include/default/Serbian/_serbian_template_yaml' 2026-02-14T10:26:44,159 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml' 2026-02-14T10:26:44,160 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml' 2026-02-14T10:26:44,161 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml' 2026-02-14T10:26:44,162 adding 'lm_eval/tasks/include/default/Serbian/utils.py' 2026-02-14T10:26:44,164 adding 'lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml' 2026-02-14T10:26:44,165 adding 'lm_eval/tasks/include/default/Spanish/_spanish_template_yaml' 2026-02-14T10:26:44,166 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml' 2026-02-14T10:26:44,168 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2026-02-14T10:26:44,169 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml' 2026-02-14T10:26:44,170 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml' 2026-02-14T10:26:44,171 adding 'lm_eval/tasks/include/default/Spanish/utils.py' 2026-02-14T10:26:44,173 adding 'lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml' 2026-02-14T10:26:44,174 adding 'lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml' 2026-02-14T10:26:44,175 adding 'lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2026-02-14T10:26:44,176 adding 'lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml' 2026-02-14T10:26:44,177 adding 'lm_eval/tasks/include/default/Tagalog/utils.py' 2026-02-14T10:26:44,179 adding 'lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml' 2026-02-14T10:26:44,180 adding 'lm_eval/tasks/include/default/Tamil/_tamil_template_yaml' 2026-02-14T10:26:44,181 adding 'lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml' 2026-02-14T10:26:44,182 adding 'lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml' 2026-02-14T10:26:44,183 adding 'lm_eval/tasks/include/default/Tamil/utils.py' 2026-02-14T10:26:44,185 adding 'lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml' 2026-02-14T10:26:44,186 adding 'lm_eval/tasks/include/default/Telugu/_telugu_template_yaml' 2026-02-14T10:26:44,188 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml' 2026-02-14T10:26:44,189 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml' 2026-02-14T10:26:44,190 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml' 2026-02-14T10:26:44,191 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml' 2026-02-14T10:26:44,192 adding 'lm_eval/tasks/include/default/Telugu/utils.py' 2026-02-14T10:26:44,194 adding 'lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml' 2026-02-14T10:26:44,195 adding 'lm_eval/tasks/include/default/Turkish/_turkish_template_yaml' 2026-02-14T10:26:44,196 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml' 2026-02-14T10:26:44,198 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml' 2026-02-14T10:26:44,199 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml' 2026-02-14T10:26:44,200 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml' 2026-02-14T10:26:44,201 adding 'lm_eval/tasks/include/default/Turkish/utils.py' 2026-02-14T10:26:44,203 adding 'lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml' 2026-02-14T10:26:44,204 adding 'lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml' 2026-02-14T10:26:44,205 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2026-02-14T10:26:44,206 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2026-02-14T10:26:44,208 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml' 2026-02-14T10:26:44,209 adding 'lm_eval/tasks/include/default/Ukrainian/utils.py' 2026-02-14T10:26:44,211 adding 'lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml' 2026-02-14T10:26:44,212 adding 'lm_eval/tasks/include/default/Urdu/_urdu_template_yaml' 2026-02-14T10:26:44,213 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml' 2026-02-14T10:26:44,214 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2026-02-14T10:26:44,216 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml' 2026-02-14T10:26:44,217 adding 'lm_eval/tasks/include/default/Urdu/utils.py' 2026-02-14T10:26:44,219 adding 'lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml' 2026-02-14T10:26:44,220 adding 'lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml' 2026-02-14T10:26:44,221 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2026-02-14T10:26:44,222 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml' 2026-02-14T10:26:44,224 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml' 2026-02-14T10:26:44,225 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml' 2026-02-14T10:26:44,226 adding 'lm_eval/tasks/include/default/Uzbek/utils.py' 2026-02-14T10:26:44,228 adding 'lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml' 2026-02-14T10:26:44,229 adding 'lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml' 2026-02-14T10:26:44,230 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2026-02-14T10:26:44,231 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2026-02-14T10:26:44,233 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml' 2026-02-14T10:26:44,234 adding 'lm_eval/tasks/include/default/Vietnamese/utils.py' 2026-02-14T10:26:44,237 adding 'lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml' 2026-02-14T10:26:44,238 adding 'lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml' 2026-02-14T10:26:44,239 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml' 2026-02-14T10:26:44,240 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml' 2026-02-14T10:26:44,241 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2026-02-14T10:26:44,242 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml' 2026-02-14T10:26:44,244 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml' 2026-02-14T10:26:44,245 adding 'lm_eval/tasks/include/few_shot_en/Albanian/utils.py' 2026-02-14T10:26:44,246 adding 'lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml' 2026-02-14T10:26:44,248 adding 'lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml' 2026-02-14T10:26:44,249 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml' 2026-02-14T10:26:44,250 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml' 2026-02-14T10:26:44,251 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml' 2026-02-14T10:26:44,253 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml' 2026-02-14T10:26:44,254 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml' 2026-02-14T10:26:44,255 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml' 2026-02-14T10:26:44,256 adding 'lm_eval/tasks/include/few_shot_en/Arabic/utils.py' 2026-02-14T10:26:44,258 adding 'lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml' 2026-02-14T10:26:44,259 adding 'lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml' 2026-02-14T10:26:44,261 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml' 2026-02-14T10:26:44,262 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml' 2026-02-14T10:26:44,263 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml' 2026-02-14T10:26:44,264 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml' 2026-02-14T10:26:44,265 adding 'lm_eval/tasks/include/few_shot_en/Armenian/utils.py' 2026-02-14T10:26:44,267 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml' 2026-02-14T10:26:44,268 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml' 2026-02-14T10:26:44,270 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2026-02-14T10:26:44,271 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2026-02-14T10:26:44,272 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2026-02-14T10:26:44,273 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2026-02-14T10:26:44,275 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2026-02-14T10:26:44,276 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2026-02-14T10:26:44,277 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py' 2026-02-14T10:26:44,279 adding 'lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml' 2026-02-14T10:26:44,280 adding 'lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml' 2026-02-14T10:26:44,281 adding 'lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml' 2026-02-14T10:26:44,282 adding 'lm_eval/tasks/include/few_shot_en/Basque/utils.py' 2026-02-14T10:26:44,284 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml' 2026-02-14T10:26:44,285 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml' 2026-02-14T10:26:44,286 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2026-02-14T10:26:44,287 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml' 2026-02-14T10:26:44,288 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml' 2026-02-14T10:26:44,290 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/utils.py' 2026-02-14T10:26:44,291 adding 'lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml' 2026-02-14T10:26:44,293 adding 'lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml' 2026-02-14T10:26:44,294 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml' 2026-02-14T10:26:44,295 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml' 2026-02-14T10:26:44,296 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml' 2026-02-14T10:26:44,297 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml' 2026-02-14T10:26:44,299 adding 'lm_eval/tasks/include/few_shot_en/Bengali/utils.py' 2026-02-14T10:26:44,300 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml' 2026-02-14T10:26:44,301 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml' 2026-02-14T10:26:44,303 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2026-02-14T10:26:44,304 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2026-02-14T10:26:44,305 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml' 2026-02-14T10:26:44,306 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py' 2026-02-14T10:26:44,308 adding 'lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml' 2026-02-14T10:26:44,309 adding 'lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml' 2026-02-14T10:26:44,310 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml' 2026-02-14T10:26:44,311 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml' 2026-02-14T10:26:44,313 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml' 2026-02-14T10:26:44,314 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml' 2026-02-14T10:26:44,315 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2026-02-14T10:26:44,316 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml' 2026-02-14T10:26:44,318 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml' 2026-02-14T10:26:44,319 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml' 2026-02-14T10:26:44,320 adding 'lm_eval/tasks/include/few_shot_en/Chinese/utils.py' 2026-02-14T10:26:44,321 adding 'lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml' 2026-02-14T10:26:44,323 adding 'lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml' 2026-02-14T10:26:44,324 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml' 2026-02-14T10:26:44,325 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml' 2026-02-14T10:26:44,326 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml' 2026-02-14T10:26:44,327 adding 'lm_eval/tasks/include/few_shot_en/Croatian/utils.py' 2026-02-14T10:26:44,329 adding 'lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml' 2026-02-14T10:26:44,330 adding 'lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml' 2026-02-14T10:26:44,331 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml' 2026-02-14T10:26:44,332 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml' 2026-02-14T10:26:44,333 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2026-02-14T10:26:44,334 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml' 2026-02-14T10:26:44,336 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml' 2026-02-14T10:26:44,337 adding 'lm_eval/tasks/include/few_shot_en/Dutch/utils.py' 2026-02-14T10:26:44,339 adding 'lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml' 2026-02-14T10:26:44,340 adding 'lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml' 2026-02-14T10:26:44,341 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml' 2026-02-14T10:26:44,342 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml' 2026-02-14T10:26:44,343 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2026-02-14T10:26:44,345 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml' 2026-02-14T10:26:44,346 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml' 2026-02-14T10:26:44,347 adding 'lm_eval/tasks/include/few_shot_en/Estonian/utils.py' 2026-02-14T10:26:44,349 adding 'lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml' 2026-02-14T10:26:44,350 adding 'lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml' 2026-02-14T10:26:44,352 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml' 2026-02-14T10:26:44,353 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml' 2026-02-14T10:26:44,354 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2026-02-14T10:26:44,355 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml' 2026-02-14T10:26:44,357 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml' 2026-02-14T10:26:44,358 adding 'lm_eval/tasks/include/few_shot_en/Finnish/utils.py' 2026-02-14T10:26:44,360 adding 'lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml' 2026-02-14T10:26:44,361 adding 'lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml' 2026-02-14T10:26:44,362 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml' 2026-02-14T10:26:44,363 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml' 2026-02-14T10:26:44,364 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml' 2026-02-14T10:26:44,365 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml' 2026-02-14T10:26:44,366 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml' 2026-02-14T10:26:44,367 adding 'lm_eval/tasks/include/few_shot_en/French/utils.py' 2026-02-14T10:26:44,369 adding 'lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml' 2026-02-14T10:26:44,370 adding 'lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml' 2026-02-14T10:26:44,371 adding 'lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml' 2026-02-14T10:26:44,372 adding 'lm_eval/tasks/include/few_shot_en/Georgian/utils.py' 2026-02-14T10:26:44,374 adding 'lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml' 2026-02-14T10:26:44,375 adding 'lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml' 2026-02-14T10:26:44,376 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml' 2026-02-14T10:26:44,377 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml' 2026-02-14T10:26:44,379 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml' 2026-02-14T10:26:44,380 adding 'lm_eval/tasks/include/few_shot_en/German/utils.py' 2026-02-14T10:26:44,382 adding 'lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml' 2026-02-14T10:26:44,383 adding 'lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml' 2026-02-14T10:26:44,384 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml' 2026-02-14T10:26:44,385 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml' 2026-02-14T10:26:44,387 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml' 2026-02-14T10:26:44,388 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml' 2026-02-14T10:26:44,389 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml' 2026-02-14T10:26:44,390 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml' 2026-02-14T10:26:44,391 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml' 2026-02-14T10:26:44,393 adding 'lm_eval/tasks/include/few_shot_en/Greek/utils.py' 2026-02-14T10:26:44,394 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml' 2026-02-14T10:26:44,396 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml' 2026-02-14T10:26:44,397 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2026-02-14T10:26:44,398 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml' 2026-02-14T10:26:44,399 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/utils.py' 2026-02-14T10:26:44,401 adding 'lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml' 2026-02-14T10:26:44,402 adding 'lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml' 2026-02-14T10:26:44,404 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml' 2026-02-14T10:26:44,405 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml' 2026-02-14T10:26:44,406 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml' 2026-02-14T10:26:44,408 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml' 2026-02-14T10:26:44,409 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2026-02-14T10:26:44,410 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml' 2026-02-14T10:26:44,411 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml' 2026-02-14T10:26:44,412 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml' 2026-02-14T10:26:44,413 adding 'lm_eval/tasks/include/few_shot_en/Hindi/utils.py' 2026-02-14T10:26:44,415 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml' 2026-02-14T10:26:44,416 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml' 2026-02-14T10:26:44,418 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml' 2026-02-14T10:26:44,419 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml' 2026-02-14T10:26:44,420 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml' 2026-02-14T10:26:44,421 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/utils.py' 2026-02-14T10:26:44,423 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml' 2026-02-14T10:26:44,424 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml' 2026-02-14T10:26:44,425 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml' 2026-02-14T10:26:44,426 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2026-02-14T10:26:44,428 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2026-02-14T10:26:44,429 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml' 2026-02-14T10:26:44,430 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml' 2026-02-14T10:26:44,431 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/utils.py' 2026-02-14T10:26:44,433 adding 'lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml' 2026-02-14T10:26:44,434 adding 'lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml' 2026-02-14T10:26:44,436 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml' 2026-02-14T10:26:44,437 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml' 2026-02-14T10:26:44,438 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml' 2026-02-14T10:26:44,439 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml' 2026-02-14T10:26:44,441 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml' 2026-02-14T10:26:44,442 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml' 2026-02-14T10:26:44,443 adding 'lm_eval/tasks/include/few_shot_en/Italian/utils.py' 2026-02-14T10:26:44,445 adding 'lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml' 2026-02-14T10:26:44,446 adding 'lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml' 2026-02-14T10:26:44,448 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml' 2026-02-14T10:26:44,449 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml' 2026-02-14T10:26:44,450 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml' 2026-02-14T10:26:44,452 adding 'lm_eval/tasks/include/few_shot_en/Japanese/utils.py' 2026-02-14T10:26:44,454 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml' 2026-02-14T10:26:44,455 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml' 2026-02-14T10:26:44,456 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2026-02-14T10:26:44,458 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/utils.py' 2026-02-14T10:26:44,459 adding 'lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml' 2026-02-14T10:26:44,460 adding 'lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml' 2026-02-14T10:26:44,462 adding 'lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml' 2026-02-14T10:26:44,463 adding 'lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml' 2026-02-14T10:26:44,464 adding 'lm_eval/tasks/include/few_shot_en/Korean/utils.py' 2026-02-14T10:26:44,466 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml' 2026-02-14T10:26:44,467 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml' 2026-02-14T10:26:44,468 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2026-02-14T10:26:44,469 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2026-02-14T10:26:44,470 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2026-02-14T10:26:44,472 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2026-02-14T10:26:44,473 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml' 2026-02-14T10:26:44,474 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py' 2026-02-14T10:26:44,476 adding 'lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml' 2026-02-14T10:26:44,477 adding 'lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml' 2026-02-14T10:26:44,478 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml' 2026-02-14T10:26:44,479 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml' 2026-02-14T10:26:44,481 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml' 2026-02-14T10:26:44,482 adding 'lm_eval/tasks/include/few_shot_en/Malay/utils.py' 2026-02-14T10:26:44,484 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml' 2026-02-14T10:26:44,485 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml' 2026-02-14T10:26:44,487 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2026-02-14T10:26:44,488 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2026-02-14T10:26:44,489 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2026-02-14T10:26:44,490 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml' 2026-02-14T10:26:44,492 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml' 2026-02-14T10:26:44,493 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml' 2026-02-14T10:26:44,494 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/utils.py' 2026-02-14T10:26:44,496 adding 'lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml' 2026-02-14T10:26:44,497 adding 'lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml' 2026-02-14T10:26:44,499 adding 'lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml' 2026-02-14T10:26:44,500 adding 'lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml' 2026-02-14T10:26:44,501 adding 'lm_eval/tasks/include/few_shot_en/Nepali/utils.py' 2026-02-14T10:26:44,503 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north macedonian.yaml' 2026-02-14T10:26:44,504 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/_north macedonian_few_shot_en_template_yaml' 2026-02-14T10:26:44,505 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml' 2026-02-14T10:26:44,506 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_business_commerce.yaml' 2026-02-14T10:26:44,508 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_social_science.yaml' 2026-02-14T10:26:44,509 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_stem.yaml' 2026-02-14T10:26:44,510 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py' 2026-02-14T10:26:44,512 adding 'lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml' 2026-02-14T10:26:44,513 adding 'lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml' 2026-02-14T10:26:44,514 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml' 2026-02-14T10:26:44,515 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml' 2026-02-14T10:26:44,516 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml' 2026-02-14T10:26:44,517 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml' 2026-02-14T10:26:44,518 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml' 2026-02-14T10:26:44,520 adding 'lm_eval/tasks/include/few_shot_en/Persian/utils.py' 2026-02-14T10:26:44,521 adding 'lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml' 2026-02-14T10:26:44,523 adding 'lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml' 2026-02-14T10:26:44,524 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml' 2026-02-14T10:26:44,525 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml' 2026-02-14T10:26:44,526 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml' 2026-02-14T10:26:44,528 adding 'lm_eval/tasks/include/few_shot_en/Polish/utils.py' 2026-02-14T10:26:44,529 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml' 2026-02-14T10:26:44,531 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml' 2026-02-14T10:26:44,532 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml' 2026-02-14T10:26:44,533 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2026-02-14T10:26:44,535 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2026-02-14T10:26:44,536 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2026-02-14T10:26:44,537 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml' 2026-02-14T10:26:44,539 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml' 2026-02-14T10:26:44,540 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/utils.py' 2026-02-14T10:26:44,542 adding 'lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml' 2026-02-14T10:26:44,543 adding 'lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml' 2026-02-14T10:26:44,544 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml' 2026-02-14T10:26:44,545 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml' 2026-02-14T10:26:44,547 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml' 2026-02-14T10:26:44,548 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml' 2026-02-14T10:26:44,549 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml' 2026-02-14T10:26:44,550 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml' 2026-02-14T10:26:44,552 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml' 2026-02-14T10:26:44,553 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml' 2026-02-14T10:26:44,554 adding 'lm_eval/tasks/include/few_shot_en/Russian/utils.py' 2026-02-14T10:26:44,555 adding 'lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml' 2026-02-14T10:26:44,557 adding 'lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml' 2026-02-14T10:26:44,558 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml' 2026-02-14T10:26:44,559 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml' 2026-02-14T10:26:44,560 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml' 2026-02-14T10:26:44,561 adding 'lm_eval/tasks/include/few_shot_en/Serbian/utils.py' 2026-02-14T10:26:44,563 adding 'lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml' 2026-02-14T10:26:44,564 adding 'lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml' 2026-02-14T10:26:44,566 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml' 2026-02-14T10:26:44,567 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2026-02-14T10:26:44,568 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml' 2026-02-14T10:26:44,569 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml' 2026-02-14T10:26:44,570 adding 'lm_eval/tasks/include/few_shot_en/Spanish/utils.py' 2026-02-14T10:26:44,572 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml' 2026-02-14T10:26:44,573 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml' 2026-02-14T10:26:44,574 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2026-02-14T10:26:44,576 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml' 2026-02-14T10:26:44,577 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/utils.py' 2026-02-14T10:26:44,578 adding 'lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml' 2026-02-14T10:26:44,580 adding 'lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml' 2026-02-14T10:26:44,581 adding 'lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml' 2026-02-14T10:26:44,582 adding 'lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml' 2026-02-14T10:26:44,583 adding 'lm_eval/tasks/include/few_shot_en/Tamil/utils.py' 2026-02-14T10:26:44,585 adding 'lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml' 2026-02-14T10:26:44,586 adding 'lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml' 2026-02-14T10:26:44,588 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml' 2026-02-14T10:26:44,589 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml' 2026-02-14T10:26:44,590 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml' 2026-02-14T10:26:44,591 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml' 2026-02-14T10:26:44,592 adding 'lm_eval/tasks/include/few_shot_en/Telugu/utils.py' 2026-02-14T10:26:44,594 adding 'lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml' 2026-02-14T10:26:44,595 adding 'lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml' 2026-02-14T10:26:44,597 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml' 2026-02-14T10:26:44,598 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml' 2026-02-14T10:26:44,599 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml' 2026-02-14T10:26:44,600 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml' 2026-02-14T10:26:44,601 adding 'lm_eval/tasks/include/few_shot_en/Turkish/utils.py' 2026-02-14T10:26:44,603 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml' 2026-02-14T10:26:44,604 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml' 2026-02-14T10:26:44,605 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2026-02-14T10:26:44,606 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2026-02-14T10:26:44,608 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml' 2026-02-14T10:26:44,609 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py' 2026-02-14T10:26:44,611 adding 'lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml' 2026-02-14T10:26:44,612 adding 'lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml' 2026-02-14T10:26:44,613 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml' 2026-02-14T10:26:44,614 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2026-02-14T10:26:44,615 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml' 2026-02-14T10:26:44,617 adding 'lm_eval/tasks/include/few_shot_en/Urdu/utils.py' 2026-02-14T10:26:44,618 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml' 2026-02-14T10:26:44,620 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml' 2026-02-14T10:26:44,621 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2026-02-14T10:26:44,622 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml' 2026-02-14T10:26:44,623 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml' 2026-02-14T10:26:44,625 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml' 2026-02-14T10:26:44,626 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/utils.py' 2026-02-14T10:26:44,628 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml' 2026-02-14T10:26:44,629 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml' 2026-02-14T10:26:44,630 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2026-02-14T10:26:44,632 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2026-02-14T10:26:44,633 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml' 2026-02-14T10:26:44,634 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py' 2026-02-14T10:26:44,637 adding 'lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml' 2026-02-14T10:26:44,638 adding 'lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml' 2026-02-14T10:26:44,639 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml' 2026-02-14T10:26:44,641 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml' 2026-02-14T10:26:44,642 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2026-02-14T10:26:44,643 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml' 2026-02-14T10:26:44,644 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml' 2026-02-14T10:26:44,646 adding 'lm_eval/tasks/include/few_shot_og/Albanian/utils.py' 2026-02-14T10:26:44,648 adding 'lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml' 2026-02-14T10:26:44,649 adding 'lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml' 2026-02-14T10:26:44,650 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml' 2026-02-14T10:26:44,651 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml' 2026-02-14T10:26:44,652 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml' 2026-02-14T10:26:44,653 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml' 2026-02-14T10:26:44,654 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml' 2026-02-14T10:26:44,656 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml' 2026-02-14T10:26:44,657 adding 'lm_eval/tasks/include/few_shot_og/Arabic/utils.py' 2026-02-14T10:26:44,659 adding 'lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml' 2026-02-14T10:26:44,660 adding 'lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml' 2026-02-14T10:26:44,661 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml' 2026-02-14T10:26:44,662 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml' 2026-02-14T10:26:44,663 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml' 2026-02-14T10:26:44,664 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml' 2026-02-14T10:26:44,666 adding 'lm_eval/tasks/include/few_shot_og/Armenian/utils.py' 2026-02-14T10:26:44,668 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml' 2026-02-14T10:26:44,669 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml' 2026-02-14T10:26:44,670 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2026-02-14T10:26:44,672 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2026-02-14T10:26:44,673 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2026-02-14T10:26:44,674 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2026-02-14T10:26:44,675 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2026-02-14T10:26:44,677 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2026-02-14T10:26:44,678 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py' 2026-02-14T10:26:44,680 adding 'lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml' 2026-02-14T10:26:44,681 adding 'lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml' 2026-02-14T10:26:44,682 adding 'lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml' 2026-02-14T10:26:44,683 adding 'lm_eval/tasks/include/few_shot_og/Basque/utils.py' 2026-02-14T10:26:44,685 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml' 2026-02-14T10:26:44,686 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml' 2026-02-14T10:26:44,688 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2026-02-14T10:26:44,689 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml' 2026-02-14T10:26:44,690 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml' 2026-02-14T10:26:44,691 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/utils.py' 2026-02-14T10:26:44,693 adding 'lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml' 2026-02-14T10:26:44,694 adding 'lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml' 2026-02-14T10:26:44,695 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml' 2026-02-14T10:26:44,697 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml' 2026-02-14T10:26:44,698 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml' 2026-02-14T10:26:44,699 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml' 2026-02-14T10:26:44,701 adding 'lm_eval/tasks/include/few_shot_og/Bengali/utils.py' 2026-02-14T10:26:44,703 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml' 2026-02-14T10:26:44,704 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml' 2026-02-14T10:26:44,706 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2026-02-14T10:26:44,707 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2026-02-14T10:26:44,708 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml' 2026-02-14T10:26:44,709 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py' 2026-02-14T10:26:44,711 adding 'lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml' 2026-02-14T10:26:44,712 adding 'lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml' 2026-02-14T10:26:44,713 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml' 2026-02-14T10:26:44,714 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml' 2026-02-14T10:26:44,716 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml' 2026-02-14T10:26:44,717 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml' 2026-02-14T10:26:44,718 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2026-02-14T10:26:44,719 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml' 2026-02-14T10:26:44,720 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml' 2026-02-14T10:26:44,722 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml' 2026-02-14T10:26:44,723 adding 'lm_eval/tasks/include/few_shot_og/Chinese/utils.py' 2026-02-14T10:26:44,725 adding 'lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml' 2026-02-14T10:26:44,726 adding 'lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml' 2026-02-14T10:26:44,727 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml' 2026-02-14T10:26:44,729 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml' 2026-02-14T10:26:44,730 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml' 2026-02-14T10:26:44,731 adding 'lm_eval/tasks/include/few_shot_og/Croatian/utils.py' 2026-02-14T10:26:44,733 adding 'lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml' 2026-02-14T10:26:44,734 adding 'lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml' 2026-02-14T10:26:44,735 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml' 2026-02-14T10:26:44,737 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml' 2026-02-14T10:26:44,738 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2026-02-14T10:26:44,739 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml' 2026-02-14T10:26:44,740 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml' 2026-02-14T10:26:44,741 adding 'lm_eval/tasks/include/few_shot_og/Dutch/utils.py' 2026-02-14T10:26:44,743 adding 'lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml' 2026-02-14T10:26:44,744 adding 'lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml' 2026-02-14T10:26:44,746 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml' 2026-02-14T10:26:44,747 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml' 2026-02-14T10:26:44,748 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2026-02-14T10:26:44,749 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml' 2026-02-14T10:26:44,750 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml' 2026-02-14T10:26:44,752 adding 'lm_eval/tasks/include/few_shot_og/Estonian/utils.py' 2026-02-14T10:26:44,753 adding 'lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml' 2026-02-14T10:26:44,754 adding 'lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml' 2026-02-14T10:26:44,756 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml' 2026-02-14T10:26:44,757 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml' 2026-02-14T10:26:44,758 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2026-02-14T10:26:44,759 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml' 2026-02-14T10:26:44,760 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml' 2026-02-14T10:26:44,762 adding 'lm_eval/tasks/include/few_shot_og/Finnish/utils.py' 2026-02-14T10:26:44,763 adding 'lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml' 2026-02-14T10:26:44,764 adding 'lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml' 2026-02-14T10:26:44,766 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml' 2026-02-14T10:26:44,767 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml' 2026-02-14T10:26:44,768 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml' 2026-02-14T10:26:44,769 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml' 2026-02-14T10:26:44,770 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml' 2026-02-14T10:26:44,772 adding 'lm_eval/tasks/include/few_shot_og/French/utils.py' 2026-02-14T10:26:44,774 adding 'lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml' 2026-02-14T10:26:44,775 adding 'lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml' 2026-02-14T10:26:44,776 adding 'lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml' 2026-02-14T10:26:44,778 adding 'lm_eval/tasks/include/few_shot_og/Georgian/utils.py' 2026-02-14T10:26:44,780 adding 'lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml' 2026-02-14T10:26:44,781 adding 'lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml' 2026-02-14T10:26:44,782 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml' 2026-02-14T10:26:44,784 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml' 2026-02-14T10:26:44,785 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml' 2026-02-14T10:26:44,786 adding 'lm_eval/tasks/include/few_shot_og/German/utils.py' 2026-02-14T10:26:44,788 adding 'lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml' 2026-02-14T10:26:44,789 adding 'lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml' 2026-02-14T10:26:44,791 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml' 2026-02-14T10:26:44,792 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml' 2026-02-14T10:26:44,793 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml' 2026-02-14T10:26:44,794 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml' 2026-02-14T10:26:44,795 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml' 2026-02-14T10:26:44,796 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml' 2026-02-14T10:26:44,798 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml' 2026-02-14T10:26:44,799 adding 'lm_eval/tasks/include/few_shot_og/Greek/utils.py' 2026-02-14T10:26:44,800 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml' 2026-02-14T10:26:44,801 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml' 2026-02-14T10:26:44,802 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2026-02-14T10:26:44,804 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml' 2026-02-14T10:26:44,805 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/utils.py' 2026-02-14T10:26:44,807 adding 'lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml' 2026-02-14T10:26:44,808 adding 'lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml' 2026-02-14T10:26:44,809 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml' 2026-02-14T10:26:44,810 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml' 2026-02-14T10:26:44,811 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml' 2026-02-14T10:26:44,812 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml' 2026-02-14T10:26:44,814 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2026-02-14T10:26:44,815 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml' 2026-02-14T10:26:44,816 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml' 2026-02-14T10:26:44,817 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml' 2026-02-14T10:26:44,818 adding 'lm_eval/tasks/include/few_shot_og/Hindi/utils.py' 2026-02-14T10:26:44,820 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml' 2026-02-14T10:26:44,821 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml' 2026-02-14T10:26:44,823 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml' 2026-02-14T10:26:44,824 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml' 2026-02-14T10:26:44,825 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml' 2026-02-14T10:26:44,827 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/utils.py' 2026-02-14T10:26:44,828 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml' 2026-02-14T10:26:44,830 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml' 2026-02-14T10:26:44,831 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml' 2026-02-14T10:26:44,832 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2026-02-14T10:26:44,833 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2026-02-14T10:26:44,834 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml' 2026-02-14T10:26:44,836 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml' 2026-02-14T10:26:44,837 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/utils.py' 2026-02-14T10:26:44,838 adding 'lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml' 2026-02-14T10:26:44,840 adding 'lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml' 2026-02-14T10:26:44,841 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml' 2026-02-14T10:26:44,842 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml' 2026-02-14T10:26:44,843 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml' 2026-02-14T10:26:44,844 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml' 2026-02-14T10:26:44,846 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml' 2026-02-14T10:26:44,847 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml' 2026-02-14T10:26:44,848 adding 'lm_eval/tasks/include/few_shot_og/Italian/utils.py' 2026-02-14T10:26:44,850 adding 'lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml' 2026-02-14T10:26:44,851 adding 'lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml' 2026-02-14T10:26:44,852 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml' 2026-02-14T10:26:44,853 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml' 2026-02-14T10:26:44,855 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml' 2026-02-14T10:26:44,856 adding 'lm_eval/tasks/include/few_shot_og/Japanese/utils.py' 2026-02-14T10:26:44,858 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml' 2026-02-14T10:26:44,859 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml' 2026-02-14T10:26:44,860 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2026-02-14T10:26:44,861 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/utils.py' 2026-02-14T10:26:44,863 adding 'lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml' 2026-02-14T10:26:44,864 adding 'lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml' 2026-02-14T10:26:44,865 adding 'lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml' 2026-02-14T10:26:44,867 adding 'lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml' 2026-02-14T10:26:44,868 adding 'lm_eval/tasks/include/few_shot_og/Korean/utils.py' 2026-02-14T10:26:44,870 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml' 2026-02-14T10:26:44,871 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml' 2026-02-14T10:26:44,872 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2026-02-14T10:26:44,873 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2026-02-14T10:26:44,874 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2026-02-14T10:26:44,875 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2026-02-14T10:26:44,877 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml' 2026-02-14T10:26:44,878 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py' 2026-02-14T10:26:44,879 adding 'lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml' 2026-02-14T10:26:44,880 adding 'lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml' 2026-02-14T10:26:44,881 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml' 2026-02-14T10:26:44,882 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml' 2026-02-14T10:26:44,883 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml' 2026-02-14T10:26:44,884 adding 'lm_eval/tasks/include/few_shot_og/Malay/utils.py' 2026-02-14T10:26:44,886 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml' 2026-02-14T10:26:44,887 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml' 2026-02-14T10:26:44,888 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2026-02-14T10:26:44,890 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2026-02-14T10:26:44,891 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2026-02-14T10:26:44,892 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml' 2026-02-14T10:26:44,893 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml' 2026-02-14T10:26:44,894 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml' 2026-02-14T10:26:44,896 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/utils.py' 2026-02-14T10:26:44,898 adding 'lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml' 2026-02-14T10:26:44,899 adding 'lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml' 2026-02-14T10:26:44,900 adding 'lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml' 2026-02-14T10:26:44,901 adding 'lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml' 2026-02-14T10:26:44,902 adding 'lm_eval/tasks/include/few_shot_og/Nepali/utils.py' 2026-02-14T10:26:44,904 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north macedonian.yaml' 2026-02-14T10:26:44,905 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/_north macedonian_few_shot_og_template_yaml' 2026-02-14T10:26:44,907 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml' 2026-02-14T10:26:44,908 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_business_commerce.yaml' 2026-02-14T10:26:44,909 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_social_science.yaml' 2026-02-14T10:26:44,910 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_stem.yaml' 2026-02-14T10:26:44,911 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py' 2026-02-14T10:26:44,913 adding 'lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml' 2026-02-14T10:26:44,915 adding 'lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml' 2026-02-14T10:26:44,916 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml' 2026-02-14T10:26:44,917 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml' 2026-02-14T10:26:44,918 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml' 2026-02-14T10:26:44,919 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml' 2026-02-14T10:26:44,921 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml' 2026-02-14T10:26:44,922 adding 'lm_eval/tasks/include/few_shot_og/Persian/utils.py' 2026-02-14T10:26:44,924 adding 'lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml' 2026-02-14T10:26:44,925 adding 'lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml' 2026-02-14T10:26:44,926 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml' 2026-02-14T10:26:44,927 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml' 2026-02-14T10:26:44,928 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml' 2026-02-14T10:26:44,929 adding 'lm_eval/tasks/include/few_shot_og/Polish/utils.py' 2026-02-14T10:26:44,931 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml' 2026-02-14T10:26:44,932 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml' 2026-02-14T10:26:44,934 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml' 2026-02-14T10:26:44,935 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2026-02-14T10:26:44,936 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2026-02-14T10:26:44,937 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2026-02-14T10:26:44,938 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml' 2026-02-14T10:26:44,940 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml' 2026-02-14T10:26:44,941 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/utils.py' 2026-02-14T10:26:44,943 adding 'lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml' 2026-02-14T10:26:44,944 adding 'lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml' 2026-02-14T10:26:44,945 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml' 2026-02-14T10:26:44,946 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml' 2026-02-14T10:26:44,947 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml' 2026-02-14T10:26:44,949 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml' 2026-02-14T10:26:44,950 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml' 2026-02-14T10:26:44,951 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml' 2026-02-14T10:26:44,953 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml' 2026-02-14T10:26:44,954 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml' 2026-02-14T10:26:44,955 adding 'lm_eval/tasks/include/few_shot_og/Russian/utils.py' 2026-02-14T10:26:44,957 adding 'lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml' 2026-02-14T10:26:44,958 adding 'lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml' 2026-02-14T10:26:44,959 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml' 2026-02-14T10:26:44,961 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml' 2026-02-14T10:26:44,962 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml' 2026-02-14T10:26:44,963 adding 'lm_eval/tasks/include/few_shot_og/Serbian/utils.py' 2026-02-14T10:26:44,965 adding 'lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml' 2026-02-14T10:26:44,967 adding 'lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml' 2026-02-14T10:26:44,968 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml' 2026-02-14T10:26:44,969 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2026-02-14T10:26:44,970 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml' 2026-02-14T10:26:44,972 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml' 2026-02-14T10:26:44,973 adding 'lm_eval/tasks/include/few_shot_og/Spanish/utils.py' 2026-02-14T10:26:44,975 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml' 2026-02-14T10:26:44,976 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml' 2026-02-14T10:26:44,977 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2026-02-14T10:26:44,978 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml' 2026-02-14T10:26:44,980 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/utils.py' 2026-02-14T10:26:44,981 adding 'lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml' 2026-02-14T10:26:44,983 adding 'lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml' 2026-02-14T10:26:44,984 adding 'lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml' 2026-02-14T10:26:44,985 adding 'lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml' 2026-02-14T10:26:44,986 adding 'lm_eval/tasks/include/few_shot_og/Tamil/utils.py' 2026-02-14T10:26:44,988 adding 'lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml' 2026-02-14T10:26:44,989 adding 'lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml' 2026-02-14T10:26:44,990 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml' 2026-02-14T10:26:44,992 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml' 2026-02-14T10:26:44,993 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml' 2026-02-14T10:26:44,994 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml' 2026-02-14T10:26:44,995 adding 'lm_eval/tasks/include/few_shot_og/Telugu/utils.py' 2026-02-14T10:26:44,997 adding 'lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml' 2026-02-14T10:26:44,998 adding 'lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml' 2026-02-14T10:26:45,000 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml' 2026-02-14T10:26:45,001 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml' 2026-02-14T10:26:45,002 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml' 2026-02-14T10:26:45,003 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml' 2026-02-14T10:26:45,004 adding 'lm_eval/tasks/include/few_shot_og/Turkish/utils.py' 2026-02-14T10:26:45,006 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml' 2026-02-14T10:26:45,008 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml' 2026-02-14T10:26:45,009 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2026-02-14T10:26:45,010 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2026-02-14T10:26:45,011 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml' 2026-02-14T10:26:45,012 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py' 2026-02-14T10:26:45,014 adding 'lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml' 2026-02-14T10:26:45,016 adding 'lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml' 2026-02-14T10:26:45,017 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml' 2026-02-14T10:26:45,019 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2026-02-14T10:26:45,020 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml' 2026-02-14T10:26:45,021 adding 'lm_eval/tasks/include/few_shot_og/Urdu/utils.py' 2026-02-14T10:26:45,023 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml' 2026-02-14T10:26:45,025 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml' 2026-02-14T10:26:45,027 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2026-02-14T10:26:45,029 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml' 2026-02-14T10:26:45,030 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml' 2026-02-14T10:26:45,031 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml' 2026-02-14T10:26:45,033 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/utils.py' 2026-02-14T10:26:45,035 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml' 2026-02-14T10:26:45,036 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml' 2026-02-14T10:26:45,037 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2026-02-14T10:26:45,038 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2026-02-14T10:26:45,039 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml' 2026-02-14T10:26:45,041 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py' 2026-02-14T10:26:45,043 adding 'lm_eval/tasks/inverse_scaling/README.md' 2026-02-14T10:26:45,044 adding 'lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml' 2026-02-14T10:26:45,045 adding 'lm_eval/tasks/inverse_scaling/_some_results' 2026-02-14T10:26:45,047 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml' 2026-02-14T10:26:45,048 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml' 2026-02-14T10:26:45,049 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml' 2026-02-14T10:26:45,050 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml' 2026-02-14T10:26:45,051 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml' 2026-02-14T10:26:45,052 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml' 2026-02-14T10:26:45,053 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml' 2026-02-14T10:26:45,055 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml' 2026-02-14T10:26:45,056 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml' 2026-02-14T10:26:45,057 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml' 2026-02-14T10:26:45,058 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml' 2026-02-14T10:26:45,061 adding 'lm_eval/tasks/japanese_leaderboard/README.md' 2026-02-14T10:26:45,062 adding 'lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml' 2026-02-14T10:26:45,063 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml' 2026-02-14T10:26:45,064 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py' 2026-02-14T10:26:45,066 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml' 2026-02-14T10:26:45,067 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml' 2026-02-14T10:26:45,068 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml' 2026-02-14T10:26:45,070 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml' 2026-02-14T10:26:45,071 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py' 2026-02-14T10:26:45,072 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml' 2026-02-14T10:26:45,074 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py' 2026-02-14T10:26:45,075 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml' 2026-02-14T10:26:45,076 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py' 2026-02-14T10:26:45,077 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml' 2026-02-14T10:26:45,078 adding 'lm_eval/tasks/japanese_leaderboard/requirements.txt' 2026-02-14T10:26:45,080 adding 'lm_eval/tasks/jsonschema_bench/README.md' 2026-02-14T10:26:45,082 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml' 2026-02-14T10:26:45,083 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml' 2026-02-14T10:26:45,084 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml' 2026-02-14T10:26:45,085 adding 'lm_eval/tasks/jsonschema_bench/metrics.py' 2026-02-14T10:26:45,087 adding 'lm_eval/tasks/kbl/README.md' 2026-02-14T10:26:45,090 adding 'lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml' 2026-02-14T10:26:45,091 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml' 2026-02-14T10:26:45,092 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml' 2026-02-14T10:26:45,093 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml' 2026-02-14T10:26:45,094 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml' 2026-02-14T10:26:45,095 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml' 2026-02-14T10:26:45,096 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml' 2026-02-14T10:26:45,098 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml' 2026-02-14T10:26:45,099 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml' 2026-02-14T10:26:45,100 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml' 2026-02-14T10:26:45,101 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml' 2026-02-14T10:26:45,102 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml' 2026-02-14T10:26:45,103 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml' 2026-02-14T10:26:45,104 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml' 2026-02-14T10:26:45,106 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml' 2026-02-14T10:26:45,107 adding 'lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml' 2026-02-14T10:26:45,109 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml' 2026-02-14T10:26:45,110 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml' 2026-02-14T10:26:45,111 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml' 2026-02-14T10:26:45,112 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml' 2026-02-14T10:26:45,113 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml' 2026-02-14T10:26:45,114 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml' 2026-02-14T10:26:45,116 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml' 2026-02-14T10:26:45,117 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml' 2026-02-14T10:26:45,118 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml' 2026-02-14T10:26:45,119 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml' 2026-02-14T10:26:45,120 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml' 2026-02-14T10:26:45,121 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml' 2026-02-14T10:26:45,123 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml' 2026-02-14T10:26:45,124 adding 'lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml' 2026-02-14T10:26:45,126 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml' 2026-02-14T10:26:45,127 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml' 2026-02-14T10:26:45,128 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml' 2026-02-14T10:26:45,129 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml' 2026-02-14T10:26:45,130 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml' 2026-02-14T10:26:45,131 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml' 2026-02-14T10:26:45,132 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml' 2026-02-14T10:26:45,134 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml' 2026-02-14T10:26:45,135 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml' 2026-02-14T10:26:45,136 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml' 2026-02-14T10:26:45,137 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml' 2026-02-14T10:26:45,138 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml' 2026-02-14T10:26:45,139 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml' 2026-02-14T10:26:45,141 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml' 2026-02-14T10:26:45,142 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml' 2026-02-14T10:26:45,143 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml' 2026-02-14T10:26:45,145 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml' 2026-02-14T10:26:45,147 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml' 2026-02-14T10:26:45,149 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml' 2026-02-14T10:26:45,150 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml' 2026-02-14T10:26:45,151 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml' 2026-02-14T10:26:45,152 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml' 2026-02-14T10:26:45,153 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml' 2026-02-14T10:26:45,154 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml' 2026-02-14T10:26:45,156 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml' 2026-02-14T10:26:45,157 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml' 2026-02-14T10:26:45,158 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml' 2026-02-14T10:26:45,159 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml' 2026-02-14T10:26:45,161 adding 'lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml' 2026-02-14T10:26:45,162 adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml' 2026-02-14T10:26:45,163 adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml' 2026-02-14T10:26:45,165 adding 'lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml' 2026-02-14T10:26:45,166 adding 'lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml' 2026-02-14T10:26:45,167 adding 'lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml' 2026-02-14T10:26:45,168 adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml' 2026-02-14T10:26:45,170 adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml' 2026-02-14T10:26:45,171 adding 'lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml' 2026-02-14T10:26:45,173 adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml' 2026-02-14T10:26:45,174 adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml' 2026-02-14T10:26:45,175 adding 'lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml' 2026-02-14T10:26:45,176 adding 'lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml' 2026-02-14T10:26:45,178 adding 'lm_eval/tasks/kmmlu/README.md' 2026-02-14T10:26:45,181 adding 'lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml' 2026-02-14T10:26:45,182 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml' 2026-02-14T10:26:45,183 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml' 2026-02-14T10:26:45,184 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml' 2026-02-14T10:26:45,185 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml' 2026-02-14T10:26:45,187 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml' 2026-02-14T10:26:45,188 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml' 2026-02-14T10:26:45,190 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml' 2026-02-14T10:26:45,192 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml' 2026-02-14T10:26:45,194 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml' 2026-02-14T10:26:45,196 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml' 2026-02-14T10:26:45,198 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml' 2026-02-14T10:26:45,200 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml' 2026-02-14T10:26:45,202 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml' 2026-02-14T10:26:45,204 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml' 2026-02-14T10:26:45,206 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml' 2026-02-14T10:26:45,208 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml' 2026-02-14T10:26:45,210 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml' 2026-02-14T10:26:45,212 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml' 2026-02-14T10:26:45,214 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml' 2026-02-14T10:26:45,216 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml' 2026-02-14T10:26:45,218 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml' 2026-02-14T10:26:45,219 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml' 2026-02-14T10:26:45,221 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml' 2026-02-14T10:26:45,223 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml' 2026-02-14T10:26:45,225 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml' 2026-02-14T10:26:45,227 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml' 2026-02-14T10:26:45,229 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml' 2026-02-14T10:26:45,231 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml' 2026-02-14T10:26:45,232 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml' 2026-02-14T10:26:45,235 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml' 2026-02-14T10:26:45,237 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml' 2026-02-14T10:26:45,239 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml' 2026-02-14T10:26:45,240 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml' 2026-02-14T10:26:45,242 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml' 2026-02-14T10:26:45,244 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml' 2026-02-14T10:26:45,246 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml' 2026-02-14T10:26:45,248 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml' 2026-02-14T10:26:45,250 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml' 2026-02-14T10:26:45,252 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml' 2026-02-14T10:26:45,254 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml' 2026-02-14T10:26:45,256 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml' 2026-02-14T10:26:45,258 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml' 2026-02-14T10:26:45,260 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml' 2026-02-14T10:26:45,262 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml' 2026-02-14T10:26:45,264 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml' 2026-02-14T10:26:45,266 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml' 2026-02-14T10:26:45,268 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml' 2026-02-14T10:26:45,269 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml' 2026-02-14T10:26:45,272 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml' 2026-02-14T10:26:45,274 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml' 2026-02-14T10:26:45,276 adding 'lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml' 2026-02-14T10:26:45,277 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml' 2026-02-14T10:26:45,278 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml' 2026-02-14T10:26:45,280 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml' 2026-02-14T10:26:45,281 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml' 2026-02-14T10:26:45,282 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml' 2026-02-14T10:26:45,283 adding 'lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml' 2026-02-14T10:26:45,284 adding 'lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml' 2026-02-14T10:26:45,285 adding 'lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml' 2026-02-14T10:26:45,286 adding 'lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml' 2026-02-14T10:26:45,288 adding 'lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml' 2026-02-14T10:26:45,289 adding 'lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml' 2026-02-14T10:26:45,290 adding 'lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml' 2026-02-14T10:26:45,291 adding 'lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml' 2026-02-14T10:26:45,292 adding 'lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml' 2026-02-14T10:26:45,293 adding 'lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml' 2026-02-14T10:26:45,295 adding 'lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml' 2026-02-14T10:26:45,296 adding 'lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml' 2026-02-14T10:26:45,297 adding 'lm_eval/tasks/kmmlu/default/kmmlu_education.yaml' 2026-02-14T10:26:45,298 adding 'lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml' 2026-02-14T10:26:45,299 adding 'lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml' 2026-02-14T10:26:45,300 adding 'lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml' 2026-02-14T10:26:45,302 adding 'lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml' 2026-02-14T10:26:45,303 adding 'lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml' 2026-02-14T10:26:45,304 adding 'lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml' 2026-02-14T10:26:45,305 adding 'lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml' 2026-02-14T10:26:45,306 adding 'lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml' 2026-02-14T10:26:45,307 adding 'lm_eval/tasks/kmmlu/default/kmmlu_health.yaml' 2026-02-14T10:26:45,309 adding 'lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml' 2026-02-14T10:26:45,310 adding 'lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml' 2026-02-14T10:26:45,311 adding 'lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml' 2026-02-14T10:26:45,312 adding 'lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml' 2026-02-14T10:26:45,313 adding 'lm_eval/tasks/kmmlu/default/kmmlu_law.yaml' 2026-02-14T10:26:45,314 adding 'lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml' 2026-02-14T10:26:45,315 adding 'lm_eval/tasks/kmmlu/default/kmmlu_management.yaml' 2026-02-14T10:26:45,317 adding 'lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml' 2026-02-14T10:26:45,318 adding 'lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml' 2026-02-14T10:26:45,319 adding 'lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml' 2026-02-14T10:26:45,320 adding 'lm_eval/tasks/kmmlu/default/kmmlu_math.yaml' 2026-02-14T10:26:45,321 adding 'lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml' 2026-02-14T10:26:45,322 adding 'lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml' 2026-02-14T10:26:45,323 adding 'lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml' 2026-02-14T10:26:45,325 adding 'lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml' 2026-02-14T10:26:45,326 adding 'lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml' 2026-02-14T10:26:45,327 adding 'lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml' 2026-02-14T10:26:45,328 adding 'lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml' 2026-02-14T10:26:45,329 adding 'lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml' 2026-02-14T10:26:45,330 adding 'lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml' 2026-02-14T10:26:45,331 adding 'lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml' 2026-02-14T10:26:45,333 adding 'lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml' 2026-02-14T10:26:45,334 adding 'lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml' 2026-02-14T10:26:45,337 adding 'lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml' 2026-02-14T10:26:45,338 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml' 2026-02-14T10:26:45,339 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml' 2026-02-14T10:26:45,340 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml' 2026-02-14T10:26:45,341 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml' 2026-02-14T10:26:45,342 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml' 2026-02-14T10:26:45,344 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml' 2026-02-14T10:26:45,345 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml' 2026-02-14T10:26:45,346 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml' 2026-02-14T10:26:45,347 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml' 2026-02-14T10:26:45,348 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml' 2026-02-14T10:26:45,349 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml' 2026-02-14T10:26:45,351 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml' 2026-02-14T10:26:45,352 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml' 2026-02-14T10:26:45,353 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml' 2026-02-14T10:26:45,354 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml' 2026-02-14T10:26:45,355 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml' 2026-02-14T10:26:45,356 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml' 2026-02-14T10:26:45,358 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml' 2026-02-14T10:26:45,359 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml' 2026-02-14T10:26:45,360 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml' 2026-02-14T10:26:45,361 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml' 2026-02-14T10:26:45,363 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml' 2026-02-14T10:26:45,364 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml' 2026-02-14T10:26:45,365 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml' 2026-02-14T10:26:45,366 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml' 2026-02-14T10:26:45,367 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml' 2026-02-14T10:26:45,368 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml' 2026-02-14T10:26:45,369 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml' 2026-02-14T10:26:45,371 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml' 2026-02-14T10:26:45,372 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml' 2026-02-14T10:26:45,373 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml' 2026-02-14T10:26:45,374 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml' 2026-02-14T10:26:45,375 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml' 2026-02-14T10:26:45,376 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml' 2026-02-14T10:26:45,377 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml' 2026-02-14T10:26:45,378 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml' 2026-02-14T10:26:45,379 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml' 2026-02-14T10:26:45,380 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml' 2026-02-14T10:26:45,382 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml' 2026-02-14T10:26:45,383 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml' 2026-02-14T10:26:45,384 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml' 2026-02-14T10:26:45,385 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml' 2026-02-14T10:26:45,387 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml' 2026-02-14T10:26:45,388 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml' 2026-02-14T10:26:45,389 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml' 2026-02-14T10:26:45,390 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml' 2026-02-14T10:26:45,391 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml' 2026-02-14T10:26:45,392 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml' 2026-02-14T10:26:45,393 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml' 2026-02-14T10:26:45,395 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml' 2026-02-14T10:26:45,397 adding 'lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml' 2026-02-14T10:26:45,398 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml' 2026-02-14T10:26:45,400 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml' 2026-02-14T10:26:45,401 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml' 2026-02-14T10:26:45,402 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml' 2026-02-14T10:26:45,403 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml' 2026-02-14T10:26:45,404 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml' 2026-02-14T10:26:45,405 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml' 2026-02-14T10:26:45,407 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml' 2026-02-14T10:26:45,408 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml' 2026-02-14T10:26:45,409 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml' 2026-02-14T10:26:45,410 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml' 2026-02-14T10:26:45,411 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml' 2026-02-14T10:26:45,412 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml' 2026-02-14T10:26:45,413 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml' 2026-02-14T10:26:45,414 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml' 2026-02-14T10:26:45,416 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml' 2026-02-14T10:26:45,417 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml' 2026-02-14T10:26:45,418 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml' 2026-02-14T10:26:45,419 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml' 2026-02-14T10:26:45,420 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml' 2026-02-14T10:26:45,421 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml' 2026-02-14T10:26:45,422 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml' 2026-02-14T10:26:45,423 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml' 2026-02-14T10:26:45,425 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml' 2026-02-14T10:26:45,426 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml' 2026-02-14T10:26:45,427 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml' 2026-02-14T10:26:45,428 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml' 2026-02-14T10:26:45,429 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml' 2026-02-14T10:26:45,431 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml' 2026-02-14T10:26:45,432 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml' 2026-02-14T10:26:45,433 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml' 2026-02-14T10:26:45,434 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml' 2026-02-14T10:26:45,435 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml' 2026-02-14T10:26:45,436 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml' 2026-02-14T10:26:45,438 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml' 2026-02-14T10:26:45,439 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml' 2026-02-14T10:26:45,440 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml' 2026-02-14T10:26:45,441 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml' 2026-02-14T10:26:45,442 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml' 2026-02-14T10:26:45,443 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml' 2026-02-14T10:26:45,445 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml' 2026-02-14T10:26:45,446 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml' 2026-02-14T10:26:45,447 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml' 2026-02-14T10:26:45,448 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml' 2026-02-14T10:26:45,449 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml' 2026-02-14T10:26:45,450 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml' 2026-02-14T10:26:45,452 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml' 2026-02-14T10:26:45,453 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml' 2026-02-14T10:26:45,454 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml' 2026-02-14T10:26:45,455 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml' 2026-02-14T10:26:45,458 adding 'lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml' 2026-02-14T10:26:45,459 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml' 2026-02-14T10:26:45,460 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml' 2026-02-14T10:26:45,461 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml' 2026-02-14T10:26:45,463 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml' 2026-02-14T10:26:45,464 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml' 2026-02-14T10:26:45,465 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml' 2026-02-14T10:26:45,466 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml' 2026-02-14T10:26:45,467 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml' 2026-02-14T10:26:45,468 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml' 2026-02-14T10:26:45,469 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml' 2026-02-14T10:26:45,470 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml' 2026-02-14T10:26:45,472 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml' 2026-02-14T10:26:45,473 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml' 2026-02-14T10:26:45,474 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml' 2026-02-14T10:26:45,475 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml' 2026-02-14T10:26:45,476 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml' 2026-02-14T10:26:45,477 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml' 2026-02-14T10:26:45,478 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml' 2026-02-14T10:26:45,480 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml' 2026-02-14T10:26:45,481 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml' 2026-02-14T10:26:45,482 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml' 2026-02-14T10:26:45,483 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml' 2026-02-14T10:26:45,484 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml' 2026-02-14T10:26:45,485 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml' 2026-02-14T10:26:45,486 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml' 2026-02-14T10:26:45,487 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml' 2026-02-14T10:26:45,489 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml' 2026-02-14T10:26:45,490 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml' 2026-02-14T10:26:45,491 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml' 2026-02-14T10:26:45,492 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml' 2026-02-14T10:26:45,493 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml' 2026-02-14T10:26:45,494 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml' 2026-02-14T10:26:45,495 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml' 2026-02-14T10:26:45,496 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml' 2026-02-14T10:26:45,498 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml' 2026-02-14T10:26:45,499 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml' 2026-02-14T10:26:45,500 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml' 2026-02-14T10:26:45,501 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml' 2026-02-14T10:26:45,502 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml' 2026-02-14T10:26:45,503 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml' 2026-02-14T10:26:45,505 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml' 2026-02-14T10:26:45,506 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml' 2026-02-14T10:26:45,507 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml' 2026-02-14T10:26:45,508 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml' 2026-02-14T10:26:45,509 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml' 2026-02-14T10:26:45,510 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml' 2026-02-14T10:26:45,511 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml' 2026-02-14T10:26:45,512 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml' 2026-02-14T10:26:45,514 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml' 2026-02-14T10:26:45,515 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml' 2026-02-14T10:26:45,516 adding 'lm_eval/tasks/kobest/README.md' 2026-02-14T10:26:45,518 adding 'lm_eval/tasks/kobest/_kobest.yaml' 2026-02-14T10:26:45,519 adding 'lm_eval/tasks/kobest/kobest_boolq.yaml' 2026-02-14T10:26:45,520 adding 'lm_eval/tasks/kobest/kobest_copa.yaml' 2026-02-14T10:26:45,521 adding 'lm_eval/tasks/kobest/kobest_hellaswag.yaml' 2026-02-14T10:26:45,522 adding 'lm_eval/tasks/kobest/kobest_sentineg.yaml' 2026-02-14T10:26:45,523 adding 'lm_eval/tasks/kobest/kobest_wic.yaml' 2026-02-14T10:26:45,525 adding 'lm_eval/tasks/kobest/utils.py' 2026-02-14T10:26:45,527 adding 'lm_eval/tasks/kormedmcqa/README.md' 2026-02-14T10:26:45,528 adding 'lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml' 2026-02-14T10:26:45,529 adding 'lm_eval/tasks/kormedmcqa/_template_yaml' 2026-02-14T10:26:45,530 adding 'lm_eval/tasks/kormedmcqa/dentist.yaml' 2026-02-14T10:26:45,531 adding 'lm_eval/tasks/kormedmcqa/doctor.yaml' 2026-02-14T10:26:45,533 adding 'lm_eval/tasks/kormedmcqa/nurse.yaml' 2026-02-14T10:26:45,534 adding 'lm_eval/tasks/kormedmcqa/pharm.yaml' 2026-02-14T10:26:45,535 adding 'lm_eval/tasks/lambada/README.md' 2026-02-14T10:26:45,537 adding 'lm_eval/tasks/lambada/lambada_openai.yaml' 2026-02-14T10:26:45,538 adding 'lm_eval/tasks/lambada/lambada_standard.yaml' 2026-02-14T10:26:45,540 adding 'lm_eval/tasks/lambada_cloze/README.md' 2026-02-14T10:26:45,541 adding 'lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml' 2026-02-14T10:26:45,542 adding 'lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml' 2026-02-14T10:26:45,544 adding 'lm_eval/tasks/lambada_multilingual/README.md' 2026-02-14T10:26:45,545 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml' 2026-02-14T10:26:45,547 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml' 2026-02-14T10:26:45,548 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml' 2026-02-14T10:26:45,549 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml' 2026-02-14T10:26:45,550 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml' 2026-02-14T10:26:45,552 adding 'lm_eval/tasks/lambada_multilingual_stablelm/README.md' 2026-02-14T10:26:45,553 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml' 2026-02-14T10:26:45,554 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml' 2026-02-14T10:26:45,555 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml' 2026-02-14T10:26:45,557 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml' 2026-02-14T10:26:45,558 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml' 2026-02-14T10:26:45,559 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml' 2026-02-14T10:26:45,560 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml' 2026-02-14T10:26:45,563 adding 'lm_eval/tasks/leaderboard/README.md' 2026-02-14T10:26:45,565 adding 'lm_eval/tasks/leaderboard/leaderboard.yaml' 2026-02-14T10:26:45,567 adding 'lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml' 2026-02-14T10:26:45,568 adding 'lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml' 2026-02-14T10:26:45,570 adding 'lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml' 2026-02-14T10:26:45,571 adding 'lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml' 2026-02-14T10:26:45,572 adding 'lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml' 2026-02-14T10:26:45,574 adding 'lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml' 2026-02-14T10:26:45,575 adding 'lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml' 2026-02-14T10:26:45,576 adding 'lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml' 2026-02-14T10:26:45,577 adding 'lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml' 2026-02-14T10:26:45,578 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml' 2026-02-14T10:26:45,580 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml' 2026-02-14T10:26:45,581 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml' 2026-02-14T10:26:45,582 adding 'lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml' 2026-02-14T10:26:45,583 adding 'lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml' 2026-02-14T10:26:45,584 adding 'lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml' 2026-02-14T10:26:45,586 adding 'lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml' 2026-02-14T10:26:45,587 adding 'lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml' 2026-02-14T10:26:45,588 adding 'lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml' 2026-02-14T10:26:45,590 adding 'lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml' 2026-02-14T10:26:45,591 adding 'lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml' 2026-02-14T10:26:45,592 adding 'lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml' 2026-02-14T10:26:45,593 adding 'lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml' 2026-02-14T10:26:45,595 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml' 2026-02-14T10:26:45,596 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml' 2026-02-14T10:26:45,597 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml' 2026-02-14T10:26:45,598 adding 'lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml' 2026-02-14T10:26:45,600 adding 'lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml' 2026-02-14T10:26:45,601 adding 'lm_eval/tasks/leaderboard/gpqa/_template_yaml' 2026-02-14T10:26:45,603 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml' 2026-02-14T10:26:45,604 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml' 2026-02-14T10:26:45,605 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml' 2026-02-14T10:26:45,607 adding 'lm_eval/tasks/leaderboard/gpqa/utils.py' 2026-02-14T10:26:45,608 adding 'lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml' 2026-02-14T10:26:45,610 adding 'lm_eval/tasks/leaderboard/ifeval/ifeval.yaml' 2026-02-14T10:26:45,615 adding 'lm_eval/tasks/leaderboard/ifeval/instructions.py' 2026-02-14T10:26:45,617 adding 'lm_eval/tasks/leaderboard/ifeval/instructions_registry.py' 2026-02-14T10:26:45,620 adding 'lm_eval/tasks/leaderboard/ifeval/instructions_util.py' 2026-02-14T10:26:45,622 adding 'lm_eval/tasks/leaderboard/ifeval/utils.py' 2026-02-14T10:26:45,624 adding 'lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml' 2026-02-14T10:26:45,625 adding 'lm_eval/tasks/leaderboard/math/_template_yaml' 2026-02-14T10:26:45,626 adding 'lm_eval/tasks/leaderboard/math/math_algebra.yaml' 2026-02-14T10:26:45,627 adding 'lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml' 2026-02-14T10:26:45,628 adding 'lm_eval/tasks/leaderboard/math/math_geometry.yaml' 2026-02-14T10:26:45,630 adding 'lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml' 2026-02-14T10:26:45,631 adding 'lm_eval/tasks/leaderboard/math/math_num_theory.yaml' 2026-02-14T10:26:45,632 adding 'lm_eval/tasks/leaderboard/math/math_prealgebra.yaml' 2026-02-14T10:26:45,633 adding 'lm_eval/tasks/leaderboard/math/math_precalculus.yaml' 2026-02-14T10:26:45,635 adding 'lm_eval/tasks/leaderboard/math/utils.py' 2026-02-14T10:26:45,638 adding 'lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml' 2026-02-14T10:26:45,639 adding 'lm_eval/tasks/leaderboard/mmlu_pro/utils.py' 2026-02-14T10:26:45,641 adding 'lm_eval/tasks/leaderboard/musr/_musr.yaml' 2026-02-14T10:26:45,642 adding 'lm_eval/tasks/leaderboard/musr/_template_yaml' 2026-02-14T10:26:45,643 adding 'lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml' 2026-02-14T10:26:45,644 adding 'lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml' 2026-02-14T10:26:45,645 adding 'lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml' 2026-02-14T10:26:45,647 adding 'lm_eval/tasks/leaderboard/musr/utils.py' 2026-02-14T10:26:45,649 adding 'lm_eval/tasks/libra/README.md' 2026-02-14T10:26:45,650 adding 'lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml' 2026-02-14T10:26:45,651 adding 'lm_eval/tasks/libra/_multi_hop_question_answering.yaml' 2026-02-14T10:26:45,652 adding 'lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml' 2026-02-14T10:26:45,653 adding 'lm_eval/tasks/libra/_simple_information_retrieval.yaml' 2026-02-14T10:26:45,655 adding 'lm_eval/tasks/libra/_template_yaml' 2026-02-14T10:26:45,656 adding 'lm_eval/tasks/libra/librusec_history.yaml' 2026-02-14T10:26:45,657 adding 'lm_eval/tasks/libra/librusec_mhqa.yaml' 2026-02-14T10:26:45,659 adding 'lm_eval/tasks/libra/long_context_multiq.yaml' 2026-02-14T10:26:45,660 adding 'lm_eval/tasks/libra/matreshka_names.yaml' 2026-02-14T10:26:45,661 adding 'lm_eval/tasks/libra/matreshka_yes_no.yaml' 2026-02-14T10:26:45,663 adding 'lm_eval/tasks/libra/passkey.yaml' 2026-02-14T10:26:45,664 adding 'lm_eval/tasks/libra/passkey_with_librusec.yaml' 2026-02-14T10:26:45,665 adding 'lm_eval/tasks/libra/ru_2wikimultihopqa.yaml' 2026-02-14T10:26:45,666 adding 'lm_eval/tasks/libra/ru_babilong_qa1.yaml' 2026-02-14T10:26:45,667 adding 'lm_eval/tasks/libra/ru_babilong_qa2.yaml' 2026-02-14T10:26:45,669 adding 'lm_eval/tasks/libra/ru_babilong_qa3.yaml' 2026-02-14T10:26:45,670 adding 'lm_eval/tasks/libra/ru_babilong_qa4.yaml' 2026-02-14T10:26:45,671 adding 'lm_eval/tasks/libra/ru_babilong_qa5.yaml' 2026-02-14T10:26:45,673 adding 'lm_eval/tasks/libra/ru_gsm100.yaml' 2026-02-14T10:26:45,674 adding 'lm_eval/tasks/libra/ru_qasper.yaml' 2026-02-14T10:26:45,675 adding 'lm_eval/tasks/libra/ru_quality.yaml' 2026-02-14T10:26:45,677 adding 'lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml' 2026-02-14T10:26:45,678 adding 'lm_eval/tasks/libra/ru_sci_passage_count.yaml' 2026-02-14T10:26:45,680 adding 'lm_eval/tasks/libra/utils.py' 2026-02-14T10:26:45,682 adding 'lm_eval/tasks/lingoly/README.md' 2026-02-14T10:26:45,683 adding 'lm_eval/tasks/lingoly/lingoly_context.yaml' 2026-02-14T10:26:45,684 adding 'lm_eval/tasks/lingoly/lingoly_group.yaml' 2026-02-14T10:26:45,686 adding 'lm_eval/tasks/lingoly/lingoly_nocontext.yaml' 2026-02-14T10:26:45,687 adding 'lm_eval/tasks/lingoly/script.py' 2026-02-14T10:26:45,688 adding 'lm_eval/tasks/lingoly/utils.py' 2026-02-14T10:26:45,691 adding 'lm_eval/tasks/llama3/README.md' 2026-02-14T10:26:45,693 adding 'lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml' 2026-02-14T10:26:45,694 adding 'lm_eval/tasks/llama3/instruct/arc_challenge/utils.py' 2026-02-14T10:26:45,696 adding 'lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml' 2026-02-14T10:26:45,699 adding 'lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml' 2026-02-14T10:26:45,701 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml' 2026-02-14T10:26:45,702 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml' 2026-02-14T10:26:45,703 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml' 2026-02-14T10:26:45,704 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml' 2026-02-14T10:26:45,706 adding 'lm_eval/tasks/llama3/instruct/mmlu/llama.yaml' 2026-02-14T10:26:45,707 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml' 2026-02-14T10:26:45,708 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml' 2026-02-14T10:26:45,709 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml' 2026-02-14T10:26:45,711 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml' 2026-02-14T10:26:45,712 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:45,713 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml' 2026-02-14T10:26:45,714 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml' 2026-02-14T10:26:45,715 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml' 2026-02-14T10:26:45,716 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml' 2026-02-14T10:26:45,718 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml' 2026-02-14T10:26:45,719 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml' 2026-02-14T10:26:45,720 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml' 2026-02-14T10:26:45,721 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml' 2026-02-14T10:26:45,722 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml' 2026-02-14T10:26:45,723 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml' 2026-02-14T10:26:45,725 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:45,726 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml' 2026-02-14T10:26:45,727 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml' 2026-02-14T10:26:45,728 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml' 2026-02-14T10:26:45,730 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:45,731 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:45,732 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml' 2026-02-14T10:26:45,733 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml' 2026-02-14T10:26:45,734 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:45,736 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:45,737 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:45,738 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:45,739 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml' 2026-02-14T10:26:45,740 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml' 2026-02-14T10:26:45,742 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml' 2026-02-14T10:26:45,743 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml' 2026-02-14T10:26:45,744 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml' 2026-02-14T10:26:45,745 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml' 2026-02-14T10:26:45,747 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml' 2026-02-14T10:26:45,748 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml' 2026-02-14T10:26:45,749 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml' 2026-02-14T10:26:45,751 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml' 2026-02-14T10:26:45,752 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml' 2026-02-14T10:26:45,753 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml' 2026-02-14T10:26:45,754 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml' 2026-02-14T10:26:45,756 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml' 2026-02-14T10:26:45,757 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml' 2026-02-14T10:26:45,758 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml' 2026-02-14T10:26:45,759 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml' 2026-02-14T10:26:45,761 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml' 2026-02-14T10:26:45,762 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml' 2026-02-14T10:26:45,763 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml' 2026-02-14T10:26:45,764 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml' 2026-02-14T10:26:45,765 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml' 2026-02-14T10:26:45,766 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml' 2026-02-14T10:26:45,767 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml' 2026-02-14T10:26:45,769 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml' 2026-02-14T10:26:45,770 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml' 2026-02-14T10:26:45,771 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml' 2026-02-14T10:26:45,772 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:45,773 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml' 2026-02-14T10:26:45,774 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml' 2026-02-14T10:26:45,777 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml' 2026-02-14T10:26:45,779 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml' 2026-02-14T10:26:45,780 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml' 2026-02-14T10:26:45,781 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml' 2026-02-14T10:26:45,782 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml' 2026-02-14T10:26:45,783 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml' 2026-02-14T10:26:45,784 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml' 2026-02-14T10:26:45,786 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml' 2026-02-14T10:26:45,787 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml' 2026-02-14T10:26:45,788 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml' 2026-02-14T10:26:45,789 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:45,790 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml' 2026-02-14T10:26:45,791 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml' 2026-02-14T10:26:45,793 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml' 2026-02-14T10:26:45,794 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml' 2026-02-14T10:26:45,795 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml' 2026-02-14T10:26:45,796 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml' 2026-02-14T10:26:45,797 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml' 2026-02-14T10:26:45,799 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml' 2026-02-14T10:26:45,800 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml' 2026-02-14T10:26:45,801 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml' 2026-02-14T10:26:45,802 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:45,803 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml' 2026-02-14T10:26:45,805 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml' 2026-02-14T10:26:45,806 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml' 2026-02-14T10:26:45,807 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:45,808 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:45,809 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml' 2026-02-14T10:26:45,811 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml' 2026-02-14T10:26:45,812 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:45,813 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:45,814 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:45,815 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:45,817 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml' 2026-02-14T10:26:45,818 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml' 2026-02-14T10:26:45,819 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml' 2026-02-14T10:26:45,820 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml' 2026-02-14T10:26:45,821 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml' 2026-02-14T10:26:45,822 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml' 2026-02-14T10:26:45,823 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml' 2026-02-14T10:26:45,825 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml' 2026-02-14T10:26:45,826 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml' 2026-02-14T10:26:45,827 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml' 2026-02-14T10:26:45,828 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml' 2026-02-14T10:26:45,829 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml' 2026-02-14T10:26:45,830 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml' 2026-02-14T10:26:45,832 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml' 2026-02-14T10:26:45,833 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml' 2026-02-14T10:26:45,834 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml' 2026-02-14T10:26:45,835 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml' 2026-02-14T10:26:45,836 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml' 2026-02-14T10:26:45,838 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml' 2026-02-14T10:26:45,839 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml' 2026-02-14T10:26:45,840 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml' 2026-02-14T10:26:45,841 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml' 2026-02-14T10:26:45,842 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml' 2026-02-14T10:26:45,844 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml' 2026-02-14T10:26:45,845 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml' 2026-02-14T10:26:45,846 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml' 2026-02-14T10:26:45,847 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml' 2026-02-14T10:26:45,848 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:45,850 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml' 2026-02-14T10:26:45,851 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml' 2026-02-14T10:26:45,854 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml' 2026-02-14T10:26:45,855 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml' 2026-02-14T10:26:45,856 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml' 2026-02-14T10:26:45,858 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml' 2026-02-14T10:26:45,859 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml' 2026-02-14T10:26:45,860 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml' 2026-02-14T10:26:45,861 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml' 2026-02-14T10:26:45,863 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml' 2026-02-14T10:26:45,864 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml' 2026-02-14T10:26:45,866 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml' 2026-02-14T10:26:45,867 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml' 2026-02-14T10:26:45,868 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml' 2026-02-14T10:26:45,870 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml' 2026-02-14T10:26:45,871 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml' 2026-02-14T10:26:45,873 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml' 2026-02-14T10:26:45,874 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml' 2026-02-14T10:26:45,876 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml' 2026-02-14T10:26:45,877 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml' 2026-02-14T10:26:45,878 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml' 2026-02-14T10:26:45,880 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml' 2026-02-14T10:26:45,881 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml' 2026-02-14T10:26:45,883 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml' 2026-02-14T10:26:45,884 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml' 2026-02-14T10:26:45,885 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml' 2026-02-14T10:26:45,887 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml' 2026-02-14T10:26:45,888 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml' 2026-02-14T10:26:45,890 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml' 2026-02-14T10:26:45,892 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml' 2026-02-14T10:26:45,894 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml' 2026-02-14T10:26:45,895 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml' 2026-02-14T10:26:45,897 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml' 2026-02-14T10:26:45,898 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml' 2026-02-14T10:26:45,900 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml' 2026-02-14T10:26:45,901 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml' 2026-02-14T10:26:45,903 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml' 2026-02-14T10:26:45,905 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml' 2026-02-14T10:26:45,907 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml' 2026-02-14T10:26:45,909 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml' 2026-02-14T10:26:45,911 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml' 2026-02-14T10:26:45,912 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml' 2026-02-14T10:26:45,913 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml' 2026-02-14T10:26:45,915 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml' 2026-02-14T10:26:45,916 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml' 2026-02-14T10:26:45,918 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml' 2026-02-14T10:26:45,919 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml' 2026-02-14T10:26:45,921 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml' 2026-02-14T10:26:45,922 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml' 2026-02-14T10:26:45,923 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml' 2026-02-14T10:26:45,925 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml' 2026-02-14T10:26:45,926 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml' 2026-02-14T10:26:45,927 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml' 2026-02-14T10:26:45,929 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml' 2026-02-14T10:26:45,930 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml' 2026-02-14T10:26:45,932 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml' 2026-02-14T10:26:45,934 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml' 2026-02-14T10:26:45,936 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml' 2026-02-14T10:26:45,937 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml' 2026-02-14T10:26:45,939 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml' 2026-02-14T10:26:45,941 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml' 2026-02-14T10:26:45,942 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml' 2026-02-14T10:26:45,943 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml' 2026-02-14T10:26:45,945 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml' 2026-02-14T10:26:45,947 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml' 2026-02-14T10:26:45,948 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/utils.py' 2026-02-14T10:26:45,952 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml' 2026-02-14T10:26:45,953 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml' 2026-02-14T10:26:45,954 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml' 2026-02-14T10:26:45,955 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml' 2026-02-14T10:26:45,957 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml' 2026-02-14T10:26:45,958 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml' 2026-02-14T10:26:45,959 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml' 2026-02-14T10:26:45,960 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml' 2026-02-14T10:26:45,962 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml' 2026-02-14T10:26:45,963 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml' 2026-02-14T10:26:45,964 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml' 2026-02-14T10:26:45,966 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml' 2026-02-14T10:26:45,967 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml' 2026-02-14T10:26:45,969 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml' 2026-02-14T10:26:45,970 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml' 2026-02-14T10:26:45,972 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml' 2026-02-14T10:26:45,973 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml' 2026-02-14T10:26:45,974 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml' 2026-02-14T10:26:45,976 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml' 2026-02-14T10:26:45,978 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml' 2026-02-14T10:26:45,979 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml' 2026-02-14T10:26:45,981 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml' 2026-02-14T10:26:45,982 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml' 2026-02-14T10:26:45,984 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml' 2026-02-14T10:26:45,985 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml' 2026-02-14T10:26:45,987 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml' 2026-02-14T10:26:45,988 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml' 2026-02-14T10:26:45,991 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml' 2026-02-14T10:26:45,993 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml' 2026-02-14T10:26:45,994 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml' 2026-02-14T10:26:45,996 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml' 2026-02-14T10:26:45,997 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml' 2026-02-14T10:26:45,998 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml' 2026-02-14T10:26:46,000 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml' 2026-02-14T10:26:46,001 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml' 2026-02-14T10:26:46,002 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml' 2026-02-14T10:26:46,005 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml' 2026-02-14T10:26:46,006 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml' 2026-02-14T10:26:46,008 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml' 2026-02-14T10:26:46,009 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml' 2026-02-14T10:26:46,010 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml' 2026-02-14T10:26:46,012 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml' 2026-02-14T10:26:46,013 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml' 2026-02-14T10:26:46,015 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml' 2026-02-14T10:26:46,016 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml' 2026-02-14T10:26:46,017 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml' 2026-02-14T10:26:46,019 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml' 2026-02-14T10:26:46,020 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml' 2026-02-14T10:26:46,022 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml' 2026-02-14T10:26:46,023 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml' 2026-02-14T10:26:46,024 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml' 2026-02-14T10:26:46,026 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml' 2026-02-14T10:26:46,027 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml' 2026-02-14T10:26:46,029 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml' 2026-02-14T10:26:46,030 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml' 2026-02-14T10:26:46,032 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml' 2026-02-14T10:26:46,034 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml' 2026-02-14T10:26:46,035 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml' 2026-02-14T10:26:46,037 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml' 2026-02-14T10:26:46,038 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml' 2026-02-14T10:26:46,040 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml' 2026-02-14T10:26:46,041 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml' 2026-02-14T10:26:46,042 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml' 2026-02-14T10:26:46,043 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/utils.py' 2026-02-14T10:26:46,046 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml' 2026-02-14T10:26:46,047 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml' 2026-02-14T10:26:46,048 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml' 2026-02-14T10:26:46,050 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml' 2026-02-14T10:26:46,051 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml' 2026-02-14T10:26:46,052 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml' 2026-02-14T10:26:46,053 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml' 2026-02-14T10:26:46,054 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml' 2026-02-14T10:26:46,056 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml' 2026-02-14T10:26:46,057 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml' 2026-02-14T10:26:46,059 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml' 2026-02-14T10:26:46,060 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml' 2026-02-14T10:26:46,061 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml' 2026-02-14T10:26:46,063 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml' 2026-02-14T10:26:46,064 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml' 2026-02-14T10:26:46,066 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml' 2026-02-14T10:26:46,067 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml' 2026-02-14T10:26:46,068 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml' 2026-02-14T10:26:46,070 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml' 2026-02-14T10:26:46,071 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml' 2026-02-14T10:26:46,072 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml' 2026-02-14T10:26:46,074 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml' 2026-02-14T10:26:46,075 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml' 2026-02-14T10:26:46,076 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml' 2026-02-14T10:26:46,078 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml' 2026-02-14T10:26:46,079 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml' 2026-02-14T10:26:46,081 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml' 2026-02-14T10:26:46,084 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml' 2026-02-14T10:26:46,085 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml' 2026-02-14T10:26:46,087 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml' 2026-02-14T10:26:46,088 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml' 2026-02-14T10:26:46,090 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml' 2026-02-14T10:26:46,091 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml' 2026-02-14T10:26:46,092 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml' 2026-02-14T10:26:46,094 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml' 2026-02-14T10:26:46,095 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml' 2026-02-14T10:26:46,098 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml' 2026-02-14T10:26:46,100 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml' 2026-02-14T10:26:46,101 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml' 2026-02-14T10:26:46,102 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml' 2026-02-14T10:26:46,104 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml' 2026-02-14T10:26:46,105 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml' 2026-02-14T10:26:46,106 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml' 2026-02-14T10:26:46,108 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml' 2026-02-14T10:26:46,109 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml' 2026-02-14T10:26:46,110 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml' 2026-02-14T10:26:46,112 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml' 2026-02-14T10:26:46,113 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml' 2026-02-14T10:26:46,114 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml' 2026-02-14T10:26:46,116 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml' 2026-02-14T10:26:46,117 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml' 2026-02-14T10:26:46,118 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml' 2026-02-14T10:26:46,120 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml' 2026-02-14T10:26:46,121 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml' 2026-02-14T10:26:46,123 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml' 2026-02-14T10:26:46,125 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml' 2026-02-14T10:26:46,126 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml' 2026-02-14T10:26:46,128 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml' 2026-02-14T10:26:46,130 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml' 2026-02-14T10:26:46,131 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml' 2026-02-14T10:26:46,132 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml' 2026-02-14T10:26:46,134 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml' 2026-02-14T10:26:46,135 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml' 2026-02-14T10:26:46,137 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py' 2026-02-14T10:26:46,140 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml' 2026-02-14T10:26:46,141 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml' 2026-02-14T10:26:46,142 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml' 2026-02-14T10:26:46,143 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml' 2026-02-14T10:26:46,144 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml' 2026-02-14T10:26:46,146 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml' 2026-02-14T10:26:46,147 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml' 2026-02-14T10:26:46,149 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml' 2026-02-14T10:26:46,151 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml' 2026-02-14T10:26:46,153 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml' 2026-02-14T10:26:46,155 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml' 2026-02-14T10:26:46,157 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml' 2026-02-14T10:26:46,159 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml' 2026-02-14T10:26:46,161 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml' 2026-02-14T10:26:46,163 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml' 2026-02-14T10:26:46,165 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml' 2026-02-14T10:26:46,166 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml' 2026-02-14T10:26:46,168 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml' 2026-02-14T10:26:46,170 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml' 2026-02-14T10:26:46,171 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml' 2026-02-14T10:26:46,173 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml' 2026-02-14T10:26:46,174 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml' 2026-02-14T10:26:46,176 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml' 2026-02-14T10:26:46,178 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml' 2026-02-14T10:26:46,180 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml' 2026-02-14T10:26:46,182 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml' 2026-02-14T10:26:46,184 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml' 2026-02-14T10:26:46,193 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml' 2026-02-14T10:26:46,196 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml' 2026-02-14T10:26:46,198 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml' 2026-02-14T10:26:46,199 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml' 2026-02-14T10:26:46,201 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml' 2026-02-14T10:26:46,203 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml' 2026-02-14T10:26:46,205 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml' 2026-02-14T10:26:46,207 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml' 2026-02-14T10:26:46,209 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml' 2026-02-14T10:26:46,217 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml' 2026-02-14T10:26:46,222 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml' 2026-02-14T10:26:46,224 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml' 2026-02-14T10:26:46,226 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml' 2026-02-14T10:26:46,229 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml' 2026-02-14T10:26:46,230 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml' 2026-02-14T10:26:46,233 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml' 2026-02-14T10:26:46,235 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml' 2026-02-14T10:26:46,237 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml' 2026-02-14T10:26:46,239 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml' 2026-02-14T10:26:46,241 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml' 2026-02-14T10:26:46,243 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml' 2026-02-14T10:26:46,245 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml' 2026-02-14T10:26:46,246 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml' 2026-02-14T10:26:46,249 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml' 2026-02-14T10:26:46,251 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml' 2026-02-14T10:26:46,253 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml' 2026-02-14T10:26:46,256 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml' 2026-02-14T10:26:46,261 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml' 2026-02-14T10:26:46,266 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml' 2026-02-14T10:26:46,268 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml' 2026-02-14T10:26:46,270 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml' 2026-02-14T10:26:46,275 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml' 2026-02-14T10:26:46,277 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml' 2026-02-14T10:26:46,279 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml' 2026-02-14T10:26:46,281 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml' 2026-02-14T10:26:46,282 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml' 2026-02-14T10:26:46,284 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py' 2026-02-14T10:26:46,287 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml' 2026-02-14T10:26:46,288 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml' 2026-02-14T10:26:46,289 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml' 2026-02-14T10:26:46,290 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml' 2026-02-14T10:26:46,291 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml' 2026-02-14T10:26:46,292 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml' 2026-02-14T10:26:46,293 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml' 2026-02-14T10:26:46,295 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml' 2026-02-14T10:26:46,296 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml' 2026-02-14T10:26:46,298 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml' 2026-02-14T10:26:46,299 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml' 2026-02-14T10:26:46,300 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml' 2026-02-14T10:26:46,302 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml' 2026-02-14T10:26:46,303 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml' 2026-02-14T10:26:46,304 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml' 2026-02-14T10:26:46,306 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml' 2026-02-14T10:26:46,307 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml' 2026-02-14T10:26:46,309 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml' 2026-02-14T10:26:46,310 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml' 2026-02-14T10:26:46,311 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml' 2026-02-14T10:26:46,313 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml' 2026-02-14T10:26:46,314 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml' 2026-02-14T10:26:46,315 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml' 2026-02-14T10:26:46,317 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml' 2026-02-14T10:26:46,318 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml' 2026-02-14T10:26:46,320 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml' 2026-02-14T10:26:46,321 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml' 2026-02-14T10:26:46,324 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml' 2026-02-14T10:26:46,325 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml' 2026-02-14T10:26:46,326 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml' 2026-02-14T10:26:46,327 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml' 2026-02-14T10:26:46,329 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml' 2026-02-14T10:26:46,330 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml' 2026-02-14T10:26:46,331 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml' 2026-02-14T10:26:46,332 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml' 2026-02-14T10:26:46,334 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml' 2026-02-14T10:26:46,336 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml' 2026-02-14T10:26:46,338 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml' 2026-02-14T10:26:46,339 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml' 2026-02-14T10:26:46,340 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml' 2026-02-14T10:26:46,342 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml' 2026-02-14T10:26:46,343 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml' 2026-02-14T10:26:46,344 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml' 2026-02-14T10:26:46,346 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml' 2026-02-14T10:26:46,347 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml' 2026-02-14T10:26:46,348 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml' 2026-02-14T10:26:46,350 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml' 2026-02-14T10:26:46,351 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml' 2026-02-14T10:26:46,352 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml' 2026-02-14T10:26:46,354 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml' 2026-02-14T10:26:46,355 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml' 2026-02-14T10:26:46,356 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml' 2026-02-14T10:26:46,358 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml' 2026-02-14T10:26:46,359 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml' 2026-02-14T10:26:46,361 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml' 2026-02-14T10:26:46,363 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml' 2026-02-14T10:26:46,364 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml' 2026-02-14T10:26:46,365 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml' 2026-02-14T10:26:46,367 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml' 2026-02-14T10:26:46,369 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml' 2026-02-14T10:26:46,370 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml' 2026-02-14T10:26:46,371 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml' 2026-02-14T10:26:46,373 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml' 2026-02-14T10:26:46,374 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/utils.py' 2026-02-14T10:26:46,376 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml' 2026-02-14T10:26:46,377 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml' 2026-02-14T10:26:46,378 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml' 2026-02-14T10:26:46,380 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml' 2026-02-14T10:26:46,381 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml' 2026-02-14T10:26:46,382 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml' 2026-02-14T10:26:46,383 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml' 2026-02-14T10:26:46,384 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml' 2026-02-14T10:26:46,385 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml' 2026-02-14T10:26:46,386 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml' 2026-02-14T10:26:46,387 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml' 2026-02-14T10:26:46,389 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml' 2026-02-14T10:26:46,390 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml' 2026-02-14T10:26:46,391 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml' 2026-02-14T10:26:46,392 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml' 2026-02-14T10:26:46,393 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml' 2026-02-14T10:26:46,394 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py' 2026-02-14T10:26:46,397 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml' 2026-02-14T10:26:46,398 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml' 2026-02-14T10:26:46,399 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml' 2026-02-14T10:26:46,401 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml' 2026-02-14T10:26:46,402 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml' 2026-02-14T10:26:46,403 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml' 2026-02-14T10:26:46,404 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml' 2026-02-14T10:26:46,406 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml' 2026-02-14T10:26:46,407 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml' 2026-02-14T10:26:46,408 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml' 2026-02-14T10:26:46,410 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml' 2026-02-14T10:26:46,411 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml' 2026-02-14T10:26:46,412 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml' 2026-02-14T10:26:46,414 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml' 2026-02-14T10:26:46,415 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml' 2026-02-14T10:26:46,417 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml' 2026-02-14T10:26:46,418 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml' 2026-02-14T10:26:46,419 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml' 2026-02-14T10:26:46,421 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml' 2026-02-14T10:26:46,422 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml' 2026-02-14T10:26:46,423 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml' 2026-02-14T10:26:46,425 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml' 2026-02-14T10:26:46,426 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml' 2026-02-14T10:26:46,427 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml' 2026-02-14T10:26:46,429 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml' 2026-02-14T10:26:46,430 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml' 2026-02-14T10:26:46,432 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml' 2026-02-14T10:26:46,434 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml' 2026-02-14T10:26:46,436 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml' 2026-02-14T10:26:46,437 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml' 2026-02-14T10:26:46,438 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml' 2026-02-14T10:26:46,439 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml' 2026-02-14T10:26:46,441 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml' 2026-02-14T10:26:46,442 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml' 2026-02-14T10:26:46,443 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml' 2026-02-14T10:26:46,445 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml' 2026-02-14T10:26:46,447 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml' 2026-02-14T10:26:46,449 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml' 2026-02-14T10:26:46,450 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml' 2026-02-14T10:26:46,451 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml' 2026-02-14T10:26:46,453 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml' 2026-02-14T10:26:46,454 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml' 2026-02-14T10:26:46,455 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml' 2026-02-14T10:26:46,457 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml' 2026-02-14T10:26:46,458 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml' 2026-02-14T10:26:46,459 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml' 2026-02-14T10:26:46,461 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml' 2026-02-14T10:26:46,462 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml' 2026-02-14T10:26:46,463 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml' 2026-02-14T10:26:46,465 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml' 2026-02-14T10:26:46,466 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml' 2026-02-14T10:26:46,468 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml' 2026-02-14T10:26:46,469 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml' 2026-02-14T10:26:46,470 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml' 2026-02-14T10:26:46,472 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml' 2026-02-14T10:26:46,474 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml' 2026-02-14T10:26:46,476 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml' 2026-02-14T10:26:46,477 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml' 2026-02-14T10:26:46,479 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml' 2026-02-14T10:26:46,480 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml' 2026-02-14T10:26:46,481 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml' 2026-02-14T10:26:46,483 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml' 2026-02-14T10:26:46,484 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml' 2026-02-14T10:26:46,485 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py' 2026-02-14T10:26:46,488 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml' 2026-02-14T10:26:46,490 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml' 2026-02-14T10:26:46,491 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml' 2026-02-14T10:26:46,492 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml' 2026-02-14T10:26:46,493 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml' 2026-02-14T10:26:46,494 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml' 2026-02-14T10:26:46,496 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml' 2026-02-14T10:26:46,497 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml' 2026-02-14T10:26:46,499 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml' 2026-02-14T10:26:46,501 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml' 2026-02-14T10:26:46,503 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml' 2026-02-14T10:26:46,505 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml' 2026-02-14T10:26:46,506 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml' 2026-02-14T10:26:46,509 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml' 2026-02-14T10:26:46,511 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml' 2026-02-14T10:26:46,513 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml' 2026-02-14T10:26:46,514 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml' 2026-02-14T10:26:46,516 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml' 2026-02-14T10:26:46,518 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml' 2026-02-14T10:26:46,520 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml' 2026-02-14T10:26:46,521 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml' 2026-02-14T10:26:46,523 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml' 2026-02-14T10:26:46,525 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml' 2026-02-14T10:26:46,526 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml' 2026-02-14T10:26:46,528 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml' 2026-02-14T10:26:46,530 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml' 2026-02-14T10:26:46,532 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml' 2026-02-14T10:26:46,542 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml' 2026-02-14T10:26:46,544 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml' 2026-02-14T10:26:46,546 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml' 2026-02-14T10:26:46,548 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml' 2026-02-14T10:26:46,550 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml' 2026-02-14T10:26:46,552 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml' 2026-02-14T10:26:46,553 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml' 2026-02-14T10:26:46,555 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml' 2026-02-14T10:26:46,558 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml' 2026-02-14T10:26:46,566 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml' 2026-02-14T10:26:46,570 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml' 2026-02-14T10:26:46,572 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml' 2026-02-14T10:26:46,573 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml' 2026-02-14T10:26:46,576 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml' 2026-02-14T10:26:46,578 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml' 2026-02-14T10:26:46,580 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml' 2026-02-14T10:26:46,582 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml' 2026-02-14T10:26:46,584 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml' 2026-02-14T10:26:46,585 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml' 2026-02-14T10:26:46,587 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml' 2026-02-14T10:26:46,588 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml' 2026-02-14T10:26:46,590 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml' 2026-02-14T10:26:46,592 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml' 2026-02-14T10:26:46,594 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml' 2026-02-14T10:26:46,596 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml' 2026-02-14T10:26:46,598 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml' 2026-02-14T10:26:46,600 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml' 2026-02-14T10:26:46,606 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml' 2026-02-14T10:26:46,609 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml' 2026-02-14T10:26:46,827 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml' 2026-02-14T10:26:46,829 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml' 2026-02-14T10:26:46,833 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml' 2026-02-14T10:26:46,835 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml' 2026-02-14T10:26:46,837 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml' 2026-02-14T10:26:46,839 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml' 2026-02-14T10:26:46,840 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml' 2026-02-14T10:26:46,842 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/utils.py' 2026-02-14T10:26:46,846 adding 'lm_eval/tasks/lm_syneval/README.md' 2026-02-14T10:26:46,847 adding 'lm_eval/tasks/lm_syneval/_template_yaml' 2026-02-14T10:26:46,849 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml' 2026-02-14T10:26:46,850 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml' 2026-02-14T10:26:46,851 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml' 2026-02-14T10:26:46,852 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml' 2026-02-14T10:26:46,853 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml' 2026-02-14T10:26:46,854 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml' 2026-02-14T10:26:46,856 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml' 2026-02-14T10:26:46,857 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml' 2026-02-14T10:26:46,858 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml' 2026-02-14T10:26:46,859 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml' 2026-02-14T10:26:46,861 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml' 2026-02-14T10:26:46,862 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml' 2026-02-14T10:26:46,863 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml' 2026-02-14T10:26:46,864 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml' 2026-02-14T10:26:46,865 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml' 2026-02-14T10:26:46,866 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml' 2026-02-14T10:26:46,867 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml' 2026-02-14T10:26:46,868 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml' 2026-02-14T10:26:46,869 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml' 2026-02-14T10:26:46,871 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml' 2026-02-14T10:26:46,872 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml' 2026-02-14T10:26:46,873 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml' 2026-02-14T10:26:46,874 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml' 2026-02-14T10:26:46,875 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml' 2026-02-14T10:26:46,876 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml' 2026-02-14T10:26:46,877 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml' 2026-02-14T10:26:46,878 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml' 2026-02-14T10:26:46,880 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml' 2026-02-14T10:26:46,881 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml' 2026-02-14T10:26:46,882 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml' 2026-02-14T10:26:46,883 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml' 2026-02-14T10:26:46,884 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml' 2026-02-14T10:26:46,885 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml' 2026-02-14T10:26:46,887 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml' 2026-02-14T10:26:46,888 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml' 2026-02-14T10:26:46,889 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml' 2026-02-14T10:26:46,890 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml' 2026-02-14T10:26:46,891 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml' 2026-02-14T10:26:46,892 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml' 2026-02-14T10:26:46,894 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml' 2026-02-14T10:26:46,895 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml' 2026-02-14T10:26:46,896 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml' 2026-02-14T10:26:46,897 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml' 2026-02-14T10:26:46,898 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml' 2026-02-14T10:26:46,900 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml' 2026-02-14T10:26:46,901 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml' 2026-02-14T10:26:46,902 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml' 2026-02-14T10:26:46,903 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml' 2026-02-14T10:26:46,904 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml' 2026-02-14T10:26:46,905 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml' 2026-02-14T10:26:46,906 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml' 2026-02-14T10:26:46,907 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml' 2026-02-14T10:26:46,908 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml' 2026-02-14T10:26:46,909 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml' 2026-02-14T10:26:46,910 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml' 2026-02-14T10:26:46,912 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml' 2026-02-14T10:26:46,913 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml' 2026-02-14T10:26:46,914 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml' 2026-02-14T10:26:46,915 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml' 2026-02-14T10:26:46,916 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml' 2026-02-14T10:26:46,917 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml' 2026-02-14T10:26:46,918 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml' 2026-02-14T10:26:46,919 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml' 2026-02-14T10:26:46,921 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml' 2026-02-14T10:26:46,922 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml' 2026-02-14T10:26:46,923 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml' 2026-02-14T10:26:46,924 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml' 2026-02-14T10:26:46,925 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml' 2026-02-14T10:26:46,926 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml' 2026-02-14T10:26:46,928 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml' 2026-02-14T10:26:46,929 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml' 2026-02-14T10:26:46,930 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml' 2026-02-14T10:26:46,932 adding 'lm_eval/tasks/lm_syneval/lm_syneval_group.yaml' 2026-02-14T10:26:46,933 adding 'lm_eval/tasks/logiqa/README.md' 2026-02-14T10:26:46,935 adding 'lm_eval/tasks/logiqa/logiqa.yaml' 2026-02-14T10:26:46,936 adding 'lm_eval/tasks/logiqa/utils_logiqa.py' 2026-02-14T10:26:46,938 adding 'lm_eval/tasks/logiqa2/README.md' 2026-02-14T10:26:46,939 adding 'lm_eval/tasks/logiqa2/logieval.yaml' 2026-02-14T10:26:46,941 adding 'lm_eval/tasks/logiqa2/logiqa2.yaml' 2026-02-14T10:26:46,942 adding 'lm_eval/tasks/logiqa2/utils_logiqa2.py' 2026-02-14T10:26:46,945 adding 'lm_eval/tasks/longbench/2wikimqa.yaml' 2026-02-14T10:26:46,946 adding 'lm_eval/tasks/longbench/2wikimqa_e.yaml' 2026-02-14T10:26:46,948 adding 'lm_eval/tasks/longbench/README.md' 2026-02-14T10:26:46,950 adding 'lm_eval/tasks/longbench/_generate_config.py' 2026-02-14T10:26:46,951 adding 'lm_eval/tasks/longbench/_longbench.yaml' 2026-02-14T10:26:46,953 adding 'lm_eval/tasks/longbench/_longbench_code.yaml' 2026-02-14T10:26:46,954 adding 'lm_eval/tasks/longbench/_longbench_code_e.yaml' 2026-02-14T10:26:46,955 adding 'lm_eval/tasks/longbench/_longbench_e.yaml' 2026-02-14T10:26:46,956 adding 'lm_eval/tasks/longbench/_longbench_fewshot.yaml' 2026-02-14T10:26:46,957 adding 'lm_eval/tasks/longbench/_longbench_fewshot_e.yaml' 2026-02-14T10:26:46,958 adding 'lm_eval/tasks/longbench/_longbench_multi.yaml' 2026-02-14T10:26:46,959 adding 'lm_eval/tasks/longbench/_longbench_multi_e.yaml' 2026-02-14T10:26:46,961 adding 'lm_eval/tasks/longbench/_longbench_single.yaml' 2026-02-14T10:26:46,962 adding 'lm_eval/tasks/longbench/_longbench_single_e.yaml' 2026-02-14T10:26:46,963 adding 'lm_eval/tasks/longbench/_longbench_summarization.yaml' 2026-02-14T10:26:46,964 adding 'lm_eval/tasks/longbench/_longbench_summarization_e.yaml' 2026-02-14T10:26:46,965 adding 'lm_eval/tasks/longbench/_longbench_synthetic.yaml' 2026-02-14T10:26:46,966 adding 'lm_eval/tasks/longbench/_longbench_synthetic_e.yaml' 2026-02-14T10:26:46,968 adding 'lm_eval/tasks/longbench/dureader.yaml' 2026-02-14T10:26:46,969 adding 'lm_eval/tasks/longbench/gov_report.yaml' 2026-02-14T10:26:46,970 adding 'lm_eval/tasks/longbench/gov_report_e.yaml' 2026-02-14T10:26:46,971 adding 'lm_eval/tasks/longbench/hotpotqa.yaml' 2026-02-14T10:26:46,973 adding 'lm_eval/tasks/longbench/hotpotqa_e.yaml' 2026-02-14T10:26:46,974 adding 'lm_eval/tasks/longbench/lcc.yaml' 2026-02-14T10:26:46,975 adding 'lm_eval/tasks/longbench/lcc_e.yaml' 2026-02-14T10:26:46,976 adding 'lm_eval/tasks/longbench/lsht.yaml' 2026-02-14T10:26:46,978 adding 'lm_eval/tasks/longbench/metrics.py' 2026-02-14T10:26:46,980 adding 'lm_eval/tasks/longbench/multi_news.yaml' 2026-02-14T10:26:46,981 adding 'lm_eval/tasks/longbench/multi_news_e.yaml' 2026-02-14T10:26:46,982 adding 'lm_eval/tasks/longbench/multifieldqa_en.yaml' 2026-02-14T10:26:46,983 adding 'lm_eval/tasks/longbench/multifieldqa_en_e.yaml' 2026-02-14T10:26:46,984 adding 'lm_eval/tasks/longbench/multifieldqa_zh.yaml' 2026-02-14T10:26:46,986 adding 'lm_eval/tasks/longbench/musique.yaml' 2026-02-14T10:26:46,987 adding 'lm_eval/tasks/longbench/narrativeqa.yaml' 2026-02-14T10:26:46,988 adding 'lm_eval/tasks/longbench/passage_count.yaml' 2026-02-14T10:26:46,990 adding 'lm_eval/tasks/longbench/passage_count_e.yaml' 2026-02-14T10:26:46,991 adding 'lm_eval/tasks/longbench/passage_retrieval_en.yaml' 2026-02-14T10:26:46,992 adding 'lm_eval/tasks/longbench/passage_retrieval_en_e.yaml' 2026-02-14T10:26:46,993 adding 'lm_eval/tasks/longbench/passage_retrieval_zh.yaml' 2026-02-14T10:26:46,995 adding 'lm_eval/tasks/longbench/qasper.yaml' 2026-02-14T10:26:46,996 adding 'lm_eval/tasks/longbench/qasper_e.yaml' 2026-02-14T10:26:46,997 adding 'lm_eval/tasks/longbench/qmsum.yaml' 2026-02-14T10:26:46,998 adding 'lm_eval/tasks/longbench/repobench-p.yaml' 2026-02-14T10:26:47,000 adding 'lm_eval/tasks/longbench/repobench-p_e.yaml' 2026-02-14T10:26:47,001 adding 'lm_eval/tasks/longbench/samsum.yaml' 2026-02-14T10:26:47,002 adding 'lm_eval/tasks/longbench/samsum_e.yaml' 2026-02-14T10:26:47,003 adding 'lm_eval/tasks/longbench/trec.yaml' 2026-02-14T10:26:47,005 adding 'lm_eval/tasks/longbench/trec_e.yaml' 2026-02-14T10:26:47,006 adding 'lm_eval/tasks/longbench/triviaqa.yaml' 2026-02-14T10:26:47,007 adding 'lm_eval/tasks/longbench/triviaqa_e.yaml' 2026-02-14T10:26:47,009 adding 'lm_eval/tasks/longbench/utils.py' 2026-02-14T10:26:47,010 adding 'lm_eval/tasks/longbench/vcsum.yaml' 2026-02-14T10:26:47,013 adding 'lm_eval/tasks/longbench2/README.md' 2026-02-14T10:26:47,014 adding 'lm_eval/tasks/longbench2/_longbench2.yaml' 2026-02-14T10:26:47,015 adding 'lm_eval/tasks/longbench2/_longbench2_history.yaml' 2026-02-14T10:26:47,016 adding 'lm_eval/tasks/longbench2/_longbench2_incontext.yaml' 2026-02-14T10:26:47,018 adding 'lm_eval/tasks/longbench2/_longbench2_multi.yaml' 2026-02-14T10:26:47,019 adding 'lm_eval/tasks/longbench2/_longbench2_single.yaml' 2026-02-14T10:26:47,020 adding 'lm_eval/tasks/longbench2/_longbench2_structured.yaml' 2026-02-14T10:26:47,021 adding 'lm_eval/tasks/longbench2/_longbench_common_yaml' 2026-02-14T10:26:47,022 adding 'lm_eval/tasks/longbench2/academic_multi_doc.yaml' 2026-02-14T10:26:47,023 adding 'lm_eval/tasks/longbench2/academic_single.yaml' 2026-02-14T10:26:47,024 adding 'lm_eval/tasks/longbench2/agent_history.yaml' 2026-02-14T10:26:47,026 adding 'lm_eval/tasks/longbench2/detective.yaml' 2026-02-14T10:26:47,027 adding 'lm_eval/tasks/longbench2/dialogue_history.yaml' 2026-02-14T10:26:47,028 adding 'lm_eval/tasks/longbench2/event_order.yaml' 2026-02-14T10:26:47,029 adding 'lm_eval/tasks/longbench2/fin_multi_doc.yaml' 2026-02-14T10:26:47,030 adding 'lm_eval/tasks/longbench2/fin_single_doc.yaml' 2026-02-14T10:26:47,031 adding 'lm_eval/tasks/longbench2/govt_multi_doc.yaml' 2026-02-14T10:26:47,032 adding 'lm_eval/tasks/longbench2/govt_single_doc.yaml' 2026-02-14T10:26:47,033 adding 'lm_eval/tasks/longbench2/graph.yaml' 2026-02-14T10:26:47,035 adding 'lm_eval/tasks/longbench2/legal_multi.yaml' 2026-02-14T10:26:47,036 adding 'lm_eval/tasks/longbench2/legal_single.yaml' 2026-02-14T10:26:47,037 adding 'lm_eval/tasks/longbench2/lit_single_doc.yaml' 2026-02-14T10:26:47,038 adding 'lm_eval/tasks/longbench2/longbench2_code.yaml' 2026-02-14T10:26:47,040 adding 'lm_eval/tasks/longbench2/many_shot.yaml' 2026-02-14T10:26:47,041 adding 'lm_eval/tasks/longbench2/news_multi.yaml' 2026-02-14T10:26:47,042 adding 'lm_eval/tasks/longbench2/table.yaml' 2026-02-14T10:26:47,043 adding 'lm_eval/tasks/longbench2/translate.yaml' 2026-02-14T10:26:47,044 adding 'lm_eval/tasks/longbench2/user_guide.yaml' 2026-02-14T10:26:47,046 adding 'lm_eval/tasks/mastermind/README.md' 2026-02-14T10:26:47,047 adding 'lm_eval/tasks/mastermind/mastermind_24_easy.yaml' 2026-02-14T10:26:47,049 adding 'lm_eval/tasks/mastermind/mastermind_24_hard.yaml' 2026-02-14T10:26:47,050 adding 'lm_eval/tasks/mastermind/mastermind_35_easy.yaml' 2026-02-14T10:26:47,051 adding 'lm_eval/tasks/mastermind/mastermind_35_hard.yaml' 2026-02-14T10:26:47,052 adding 'lm_eval/tasks/mastermind/mastermind_46_easy.yaml' 2026-02-14T10:26:47,053 adding 'lm_eval/tasks/mastermind/mastermind_46_hard.yaml' 2026-02-14T10:26:47,055 adding 'lm_eval/tasks/mathqa/README.md' 2026-02-14T10:26:47,056 adding 'lm_eval/tasks/mathqa/mathqa.yaml' 2026-02-14T10:26:47,057 adding 'lm_eval/tasks/mathqa/utils.py' 2026-02-14T10:26:47,059 adding 'lm_eval/tasks/mbpp/README.md' 2026-02-14T10:26:47,061 adding 'lm_eval/tasks/mbpp/mbpp.yaml' 2026-02-14T10:26:47,062 adding 'lm_eval/tasks/mbpp/mbpp_instruct.yaml' 2026-02-14T10:26:47,063 adding 'lm_eval/tasks/mbpp/mbpp_plus.yaml' 2026-02-14T10:26:47,064 adding 'lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml' 2026-02-14T10:26:47,066 adding 'lm_eval/tasks/mbpp/utils.py' 2026-02-14T10:26:47,068 adding 'lm_eval/tasks/mc_taco/README.md' 2026-02-14T10:26:47,069 adding 'lm_eval/tasks/mc_taco/default.yaml' 2026-02-14T10:26:47,072 adding 'lm_eval/tasks/med_concepts_qa/README.md' 2026-02-14T10:26:47,073 adding 'lm_eval/tasks/med_concepts_qa/_default_template_yaml' 2026-02-14T10:26:47,074 adding 'lm_eval/tasks/med_concepts_qa/_generate_configs.py' 2026-02-14T10:26:47,075 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml' 2026-02-14T10:26:47,077 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml' 2026-02-14T10:26:47,078 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml' 2026-02-14T10:26:47,079 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml' 2026-02-14T10:26:47,080 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml' 2026-02-14T10:26:47,081 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml' 2026-02-14T10:26:47,083 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml' 2026-02-14T10:26:47,084 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml' 2026-02-14T10:26:47,085 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml' 2026-02-14T10:26:47,086 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml' 2026-02-14T10:26:47,087 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml' 2026-02-14T10:26:47,088 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml' 2026-02-14T10:26:47,089 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml' 2026-02-14T10:26:47,091 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml' 2026-02-14T10:26:47,092 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml' 2026-02-14T10:26:47,093 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml' 2026-02-14T10:26:47,094 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml' 2026-02-14T10:26:47,095 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml' 2026-02-14T10:26:47,097 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml' 2026-02-14T10:26:47,098 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml' 2026-02-14T10:26:47,099 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml' 2026-02-14T10:26:47,101 adding 'lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml' 2026-02-14T10:26:47,102 adding 'lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml' 2026-02-14T10:26:47,114 adding 'lm_eval/tasks/med_prescriptions/utils.py' 2026-02-14T10:26:47,116 adding 'lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml' 2026-02-14T10:26:47,117 adding 'lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml' 2026-02-14T10:26:47,119 adding 'lm_eval/tasks/med_text_classification/utils.py' 2026-02-14T10:26:47,121 adding 'lm_eval/tasks/meddialog/README.md' 2026-02-14T10:26:47,122 adding 'lm_eval/tasks/meddialog/meddialog_qsumm.yaml' 2026-02-14T10:26:47,123 adding 'lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml' 2026-02-14T10:26:47,124 adding 'lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml' 2026-02-14T10:26:47,126 adding 'lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml' 2026-02-14T10:26:47,127 adding 'lm_eval/tasks/meddialog/utils.py' 2026-02-14T10:26:47,128 adding 'lm_eval/tasks/meddialog/utils_perplexity.py' 2026-02-14T10:26:47,130 adding 'lm_eval/tasks/mediqa_qa2019/README.md' 2026-02-14T10:26:47,131 adding 'lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml' 2026-02-14T10:26:47,133 adding 'lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml' 2026-02-14T10:26:47,134 adding 'lm_eval/tasks/mediqa_qa2019/utils.py' 2026-02-14T10:26:47,135 adding 'lm_eval/tasks/mediqa_qa2019/utils_perplexity.py' 2026-02-14T10:26:47,137 adding 'lm_eval/tasks/medmcqa/medmcqa.yaml' 2026-02-14T10:26:47,138 adding 'lm_eval/tasks/medmcqa/utils_medmcqa.py' 2026-02-14T10:26:47,140 adding 'lm_eval/tasks/medqa/medqa.yaml' 2026-02-14T10:26:47,142 adding 'lm_eval/tasks/medqa/preprocess_medqa.py' 2026-02-14T10:26:47,144 adding 'lm_eval/tasks/medtext/README.md' 2026-02-14T10:26:47,145 adding 'lm_eval/tasks/medtext/medtext.yaml' 2026-02-14T10:26:47,147 adding 'lm_eval/tasks/medtext/medtext_perplexity.yaml' 2026-02-14T10:26:47,148 adding 'lm_eval/tasks/medtext/utils.py' 2026-02-14T10:26:47,149 adding 'lm_eval/tasks/medtext/utils_perplexity.py' 2026-02-14T10:26:47,151 adding 'lm_eval/tasks/mela/README.md' 2026-02-14T10:26:47,153 adding 'lm_eval/tasks/mela/_mela.yaml' 2026-02-14T10:26:47,154 adding 'lm_eval/tasks/mela/mela_ar.yaml' 2026-02-14T10:26:47,155 adding 'lm_eval/tasks/mela/mela_de.yaml' 2026-02-14T10:26:47,156 adding 'lm_eval/tasks/mela/mela_en.yaml' 2026-02-14T10:26:47,157 adding 'lm_eval/tasks/mela/mela_es.yaml' 2026-02-14T10:26:47,159 adding 'lm_eval/tasks/mela/mela_fr.yaml' 2026-02-14T10:26:47,160 adding 'lm_eval/tasks/mela/mela_is.yaml' 2026-02-14T10:26:47,161 adding 'lm_eval/tasks/mela/mela_it.yaml' 2026-02-14T10:26:47,162 adding 'lm_eval/tasks/mela/mela_ja.yaml' 2026-02-14T10:26:47,163 adding 'lm_eval/tasks/mela/mela_ru.yaml' 2026-02-14T10:26:47,164 adding 'lm_eval/tasks/mela/mela_zh.yaml' 2026-02-14T10:26:47,166 adding 'lm_eval/tasks/meqsum/README.md' 2026-02-14T10:26:47,167 adding 'lm_eval/tasks/meqsum/meqsum.yaml' 2026-02-14T10:26:47,168 adding 'lm_eval/tasks/meqsum/utils.py' 2026-02-14T10:26:47,171 adding 'lm_eval/tasks/metabench/README.md' 2026-02-14T10:26:47,172 adding 'lm_eval/tasks/metabench/metabench.yaml' 2026-02-14T10:26:47,173 adding 'lm_eval/tasks/metabench/metabench_arc.yaml' 2026-02-14T10:26:47,175 adding 'lm_eval/tasks/metabench/metabench_arc_permute.yaml' 2026-02-14T10:26:47,176 adding 'lm_eval/tasks/metabench/metabench_arc_secondary.yaml' 2026-02-14T10:26:47,177 adding 'lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml' 2026-02-14T10:26:47,178 adding 'lm_eval/tasks/metabench/metabench_gsm8k.yaml' 2026-02-14T10:26:47,179 adding 'lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml' 2026-02-14T10:26:47,181 adding 'lm_eval/tasks/metabench/metabench_hellaswag.yaml' 2026-02-14T10:26:47,182 adding 'lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml' 2026-02-14T10:26:47,183 adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml' 2026-02-14T10:26:47,185 adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml' 2026-02-14T10:26:47,186 adding 'lm_eval/tasks/metabench/metabench_mmlu.yaml' 2026-02-14T10:26:47,187 adding 'lm_eval/tasks/metabench/metabench_mmlu_permute.yaml' 2026-02-14T10:26:47,188 adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml' 2026-02-14T10:26:47,189 adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml' 2026-02-14T10:26:47,191 adding 'lm_eval/tasks/metabench/metabench_permute.yaml' 2026-02-14T10:26:47,192 adding 'lm_eval/tasks/metabench/metabench_secondary.yaml' 2026-02-14T10:26:47,193 adding 'lm_eval/tasks/metabench/metabench_secondary_permute.yaml' 2026-02-14T10:26:47,194 adding 'lm_eval/tasks/metabench/metabench_truthfulqa.yaml' 2026-02-14T10:26:47,196 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml' 2026-02-14T10:26:47,197 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml' 2026-02-14T10:26:47,198 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml' 2026-02-14T10:26:47,199 adding 'lm_eval/tasks/metabench/metabench_winogrande.yaml' 2026-02-14T10:26:47,200 adding 'lm_eval/tasks/metabench/metabench_winogrande_permute.yaml' 2026-02-14T10:26:47,202 adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml' 2026-02-14T10:26:47,203 adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml' 2026-02-14T10:26:47,204 adding 'lm_eval/tasks/metabench/process_docs.py' 2026-02-14T10:26:47,206 adding 'lm_eval/tasks/metabench/process_docs_permute.py' 2026-02-14T10:26:47,208 adding 'lm_eval/tasks/mgsm/README.md' 2026-02-14T10:26:47,209 adding 'lm_eval/tasks/mgsm/gen_yaml.sh' 2026-02-14T10:26:47,211 adding 'lm_eval/tasks/mgsm/utils.py' 2026-02-14T10:26:47,213 adding 'lm_eval/tasks/mgsm/direct/direct_yaml' 2026-02-14T10:26:47,214 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml' 2026-02-14T10:26:47,215 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml' 2026-02-14T10:26:47,217 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml' 2026-02-14T10:26:47,218 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml' 2026-02-14T10:26:47,219 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml' 2026-02-14T10:26:47,220 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml' 2026-02-14T10:26:47,222 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml' 2026-02-14T10:26:47,223 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml' 2026-02-14T10:26:47,224 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml' 2026-02-14T10:26:47,225 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml' 2026-02-14T10:26:47,227 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml' 2026-02-14T10:26:47,228 adding 'lm_eval/tasks/mgsm/en_cot/cot_yaml' 2026-02-14T10:26:47,229 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml' 2026-02-14T10:26:47,231 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml' 2026-02-14T10:26:47,232 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml' 2026-02-14T10:26:47,233 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml' 2026-02-14T10:26:47,234 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml' 2026-02-14T10:26:47,235 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml' 2026-02-14T10:26:47,236 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml' 2026-02-14T10:26:47,237 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml' 2026-02-14T10:26:47,238 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml' 2026-02-14T10:26:47,240 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml' 2026-02-14T10:26:47,241 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml' 2026-02-14T10:26:47,242 adding 'lm_eval/tasks/mgsm/native_cot/cot_yaml' 2026-02-14T10:26:47,244 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml' 2026-02-14T10:26:47,245 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml' 2026-02-14T10:26:47,247 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml' 2026-02-14T10:26:47,248 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml' 2026-02-14T10:26:47,249 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml' 2026-02-14T10:26:47,250 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml' 2026-02-14T10:26:47,251 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml' 2026-02-14T10:26:47,252 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml' 2026-02-14T10:26:47,253 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml' 2026-02-14T10:26:47,255 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml' 2026-02-14T10:26:47,256 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml' 2026-02-14T10:26:47,258 adding 'lm_eval/tasks/mimic_repsum/README.md' 2026-02-14T10:26:47,259 adding 'lm_eval/tasks/mimic_repsum/mimic_repsum.yaml' 2026-02-14T10:26:47,260 adding 'lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml' 2026-02-14T10:26:47,262 adding 'lm_eval/tasks/mimic_repsum/utils.py' 2026-02-14T10:26:47,263 adding 'lm_eval/tasks/mimic_repsum/utils_perplexity.py' 2026-02-14T10:26:47,265 adding 'lm_eval/tasks/minerva_math/README.md' 2026-02-14T10:26:47,266 adding 'lm_eval/tasks/minerva_math/minerva_math500.yaml' 2026-02-14T10:26:47,267 adding 'lm_eval/tasks/minerva_math/minerva_math_algebra.yaml' 2026-02-14T10:26:47,269 adding 'lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml' 2026-02-14T10:26:47,270 adding 'lm_eval/tasks/minerva_math/minerva_math_geometry.yaml' 2026-02-14T10:26:47,271 adding 'lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml' 2026-02-14T10:26:47,272 adding 'lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml' 2026-02-14T10:26:47,273 adding 'lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml' 2026-02-14T10:26:47,274 adding 'lm_eval/tasks/minerva_math/minerva_math_precalc.yaml' 2026-02-14T10:26:47,276 adding 'lm_eval/tasks/minerva_math/utils.py' 2026-02-14T10:26:47,279 adding 'lm_eval/tasks/mlqa/README.md' 2026-02-14T10:26:47,280 adding 'lm_eval/tasks/mlqa/generate_tasks.py' 2026-02-14T10:26:47,282 adding 'lm_eval/tasks/mlqa/mlqa_ar_ar.yaml' 2026-02-14T10:26:47,283 adding 'lm_eval/tasks/mlqa/mlqa_ar_de.yaml' 2026-02-14T10:26:47,284 adding 'lm_eval/tasks/mlqa/mlqa_ar_en.yaml' 2026-02-14T10:26:47,285 adding 'lm_eval/tasks/mlqa/mlqa_ar_es.yaml' 2026-02-14T10:26:47,286 adding 'lm_eval/tasks/mlqa/mlqa_ar_hi.yaml' 2026-02-14T10:26:47,287 adding 'lm_eval/tasks/mlqa/mlqa_ar_vi.yaml' 2026-02-14T10:26:47,289 adding 'lm_eval/tasks/mlqa/mlqa_ar_zh.yaml' 2026-02-14T10:26:47,290 adding 'lm_eval/tasks/mlqa/mlqa_common_yaml' 2026-02-14T10:26:47,291 adding 'lm_eval/tasks/mlqa/mlqa_de_ar.yaml' 2026-02-14T10:26:47,292 adding 'lm_eval/tasks/mlqa/mlqa_de_de.yaml' 2026-02-14T10:26:47,293 adding 'lm_eval/tasks/mlqa/mlqa_de_en.yaml' 2026-02-14T10:26:47,294 adding 'lm_eval/tasks/mlqa/mlqa_de_es.yaml' 2026-02-14T10:26:47,295 adding 'lm_eval/tasks/mlqa/mlqa_de_hi.yaml' 2026-02-14T10:26:47,296 adding 'lm_eval/tasks/mlqa/mlqa_de_vi.yaml' 2026-02-14T10:26:47,297 adding 'lm_eval/tasks/mlqa/mlqa_de_zh.yaml' 2026-02-14T10:26:47,299 adding 'lm_eval/tasks/mlqa/mlqa_en_ar.yaml' 2026-02-14T10:26:47,300 adding 'lm_eval/tasks/mlqa/mlqa_en_de.yaml' 2026-02-14T10:26:47,301 adding 'lm_eval/tasks/mlqa/mlqa_en_en.yaml' 2026-02-14T10:26:47,302 adding 'lm_eval/tasks/mlqa/mlqa_en_es.yaml' 2026-02-14T10:26:47,303 adding 'lm_eval/tasks/mlqa/mlqa_en_hi.yaml' 2026-02-14T10:26:47,304 adding 'lm_eval/tasks/mlqa/mlqa_en_vi.yaml' 2026-02-14T10:26:47,305 adding 'lm_eval/tasks/mlqa/mlqa_en_zh.yaml' 2026-02-14T10:26:47,306 adding 'lm_eval/tasks/mlqa/mlqa_es_ar.yaml' 2026-02-14T10:26:47,307 adding 'lm_eval/tasks/mlqa/mlqa_es_de.yaml' 2026-02-14T10:26:47,309 adding 'lm_eval/tasks/mlqa/mlqa_es_en.yaml' 2026-02-14T10:26:47,310 adding 'lm_eval/tasks/mlqa/mlqa_es_es.yaml' 2026-02-14T10:26:47,311 adding 'lm_eval/tasks/mlqa/mlqa_es_hi.yaml' 2026-02-14T10:26:47,312 adding 'lm_eval/tasks/mlqa/mlqa_es_vi.yaml' 2026-02-14T10:26:47,313 adding 'lm_eval/tasks/mlqa/mlqa_es_zh.yaml' 2026-02-14T10:26:47,314 adding 'lm_eval/tasks/mlqa/mlqa_hi_ar.yaml' 2026-02-14T10:26:47,315 adding 'lm_eval/tasks/mlqa/mlqa_hi_de.yaml' 2026-02-14T10:26:47,316 adding 'lm_eval/tasks/mlqa/mlqa_hi_en.yaml' 2026-02-14T10:26:47,318 adding 'lm_eval/tasks/mlqa/mlqa_hi_es.yaml' 2026-02-14T10:26:47,319 adding 'lm_eval/tasks/mlqa/mlqa_hi_hi.yaml' 2026-02-14T10:26:47,320 adding 'lm_eval/tasks/mlqa/mlqa_hi_vi.yaml' 2026-02-14T10:26:47,321 adding 'lm_eval/tasks/mlqa/mlqa_hi_zh.yaml' 2026-02-14T10:26:47,322 adding 'lm_eval/tasks/mlqa/mlqa_vi_ar.yaml' 2026-02-14T10:26:47,323 adding 'lm_eval/tasks/mlqa/mlqa_vi_de.yaml' 2026-02-14T10:26:47,324 adding 'lm_eval/tasks/mlqa/mlqa_vi_en.yaml' 2026-02-14T10:26:47,325 adding 'lm_eval/tasks/mlqa/mlqa_vi_es.yaml' 2026-02-14T10:26:47,327 adding 'lm_eval/tasks/mlqa/mlqa_vi_hi.yaml' 2026-02-14T10:26:47,328 adding 'lm_eval/tasks/mlqa/mlqa_vi_vi.yaml' 2026-02-14T10:26:47,329 adding 'lm_eval/tasks/mlqa/mlqa_vi_zh.yaml' 2026-02-14T10:26:47,330 adding 'lm_eval/tasks/mlqa/mlqa_zh_ar.yaml' 2026-02-14T10:26:47,331 adding 'lm_eval/tasks/mlqa/mlqa_zh_de.yaml' 2026-02-14T10:26:47,332 adding 'lm_eval/tasks/mlqa/mlqa_zh_en.yaml' 2026-02-14T10:26:47,334 adding 'lm_eval/tasks/mlqa/mlqa_zh_es.yaml' 2026-02-14T10:26:47,335 adding 'lm_eval/tasks/mlqa/mlqa_zh_hi.yaml' 2026-02-14T10:26:47,336 adding 'lm_eval/tasks/mlqa/mlqa_zh_vi.yaml' 2026-02-14T10:26:47,337 adding 'lm_eval/tasks/mlqa/mlqa_zh_zh.yaml' 2026-02-14T10:26:47,339 adding 'lm_eval/tasks/mlqa/utils.py' 2026-02-14T10:26:47,341 adding 'lm_eval/tasks/mmlu/README.md' 2026-02-14T10:26:47,342 adding 'lm_eval/tasks/mmlu/_generate_configs.py' 2026-02-14T10:26:47,345 adding 'lm_eval/tasks/mmlu/continuation/_continuation_template_yaml' 2026-02-14T10:26:47,346 adding 'lm_eval/tasks/mmlu/continuation/_mmlu.yaml' 2026-02-14T10:26:47,347 adding 'lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml' 2026-02-14T10:26:47,349 adding 'lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml' 2026-02-14T10:26:47,350 adding 'lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml' 2026-02-14T10:26:47,351 adding 'lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml' 2026-02-14T10:26:47,352 adding 'lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:47,353 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml' 2026-02-14T10:26:47,354 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml' 2026-02-14T10:26:47,356 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml' 2026-02-14T10:26:47,357 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml' 2026-02-14T10:26:47,358 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml' 2026-02-14T10:26:47,359 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml' 2026-02-14T10:26:47,360 adding 'lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml' 2026-02-14T10:26:47,361 adding 'lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml' 2026-02-14T10:26:47,362 adding 'lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml' 2026-02-14T10:26:47,363 adding 'lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml' 2026-02-14T10:26:47,365 adding 'lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:47,366 adding 'lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml' 2026-02-14T10:26:47,367 adding 'lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml' 2026-02-14T10:26:47,368 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml' 2026-02-14T10:26:47,369 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:47,370 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:47,372 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml' 2026-02-14T10:26:47,373 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml' 2026-02-14T10:26:47,374 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:47,375 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:47,376 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:47,377 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:47,378 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml' 2026-02-14T10:26:47,379 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml' 2026-02-14T10:26:47,381 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml' 2026-02-14T10:26:47,382 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml' 2026-02-14T10:26:47,383 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml' 2026-02-14T10:26:47,384 adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml' 2026-02-14T10:26:47,385 adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml' 2026-02-14T10:26:47,387 adding 'lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml' 2026-02-14T10:26:47,388 adding 'lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml' 2026-02-14T10:26:47,389 adding 'lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml' 2026-02-14T10:26:47,390 adding 'lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml' 2026-02-14T10:26:47,391 adding 'lm_eval/tasks/mmlu/continuation/mmlu_management.yaml' 2026-02-14T10:26:47,392 adding 'lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml' 2026-02-14T10:26:47,394 adding 'lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml' 2026-02-14T10:26:47,395 adding 'lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml' 2026-02-14T10:26:47,396 adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml' 2026-02-14T10:26:47,397 adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml' 2026-02-14T10:26:47,398 adding 'lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml' 2026-02-14T10:26:47,399 adding 'lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml' 2026-02-14T10:26:47,401 adding 'lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml' 2026-02-14T10:26:47,402 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml' 2026-02-14T10:26:47,403 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml' 2026-02-14T10:26:47,404 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml' 2026-02-14T10:26:47,405 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml' 2026-02-14T10:26:47,407 adding 'lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml' 2026-02-14T10:26:47,408 adding 'lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml' 2026-02-14T10:26:47,409 adding 'lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml' 2026-02-14T10:26:47,410 adding 'lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:47,411 adding 'lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml' 2026-02-14T10:26:47,412 adding 'lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml' 2026-02-14T10:26:47,415 adding 'lm_eval/tasks/mmlu/default/_default_template_yaml' 2026-02-14T10:26:47,416 adding 'lm_eval/tasks/mmlu/default/_mmlu.yaml' 2026-02-14T10:26:47,417 adding 'lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml' 2026-02-14T10:26:47,418 adding 'lm_eval/tasks/mmlu/default/_mmlu_other.yaml' 2026-02-14T10:26:47,420 adding 'lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml' 2026-02-14T10:26:47,423 adding 'lm_eval/tasks/mmlu/default/_mmlu_stem.yaml' 2026-02-14T10:26:47,425 adding 'lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml' 2026-02-14T10:26:47,426 adding 'lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml' 2026-02-14T10:26:47,427 adding 'lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml' 2026-02-14T10:26:47,428 adding 'lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml' 2026-02-14T10:26:47,429 adding 'lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:47,430 adding 'lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml' 2026-02-14T10:26:47,431 adding 'lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml' 2026-02-14T10:26:47,433 adding 'lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml' 2026-02-14T10:26:47,434 adding 'lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml' 2026-02-14T10:26:47,435 adding 'lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml' 2026-02-14T10:26:47,436 adding 'lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml' 2026-02-14T10:26:47,437 adding 'lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml' 2026-02-14T10:26:47,438 adding 'lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml' 2026-02-14T10:26:47,440 adding 'lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml' 2026-02-14T10:26:47,441 adding 'lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml' 2026-02-14T10:26:47,442 adding 'lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:47,443 adding 'lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml' 2026-02-14T10:26:47,444 adding 'lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml' 2026-02-14T10:26:47,445 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml' 2026-02-14T10:26:47,447 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:47,448 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:47,449 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml' 2026-02-14T10:26:47,450 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml' 2026-02-14T10:26:47,452 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:47,453 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:47,454 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:47,455 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:47,456 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml' 2026-02-14T10:26:47,458 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml' 2026-02-14T10:26:47,459 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml' 2026-02-14T10:26:47,460 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml' 2026-02-14T10:26:47,461 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml' 2026-02-14T10:26:47,462 adding 'lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml' 2026-02-14T10:26:47,464 adding 'lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml' 2026-02-14T10:26:47,465 adding 'lm_eval/tasks/mmlu/default/mmlu_international_law.yaml' 2026-02-14T10:26:47,466 adding 'lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml' 2026-02-14T10:26:47,467 adding 'lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml' 2026-02-14T10:26:47,468 adding 'lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml' 2026-02-14T10:26:47,469 adding 'lm_eval/tasks/mmlu/default/mmlu_management.yaml' 2026-02-14T10:26:47,470 adding 'lm_eval/tasks/mmlu/default/mmlu_marketing.yaml' 2026-02-14T10:26:47,471 adding 'lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml' 2026-02-14T10:26:47,473 adding 'lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml' 2026-02-14T10:26:47,474 adding 'lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml' 2026-02-14T10:26:47,475 adding 'lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml' 2026-02-14T10:26:47,476 adding 'lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml' 2026-02-14T10:26:47,477 adding 'lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml' 2026-02-14T10:26:47,478 adding 'lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml' 2026-02-14T10:26:47,479 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml' 2026-02-14T10:26:47,481 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml' 2026-02-14T10:26:47,482 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml' 2026-02-14T10:26:47,483 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml' 2026-02-14T10:26:47,484 adding 'lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml' 2026-02-14T10:26:47,485 adding 'lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml' 2026-02-14T10:26:47,486 adding 'lm_eval/tasks/mmlu/default/mmlu_sociology.yaml' 2026-02-14T10:26:47,487 adding 'lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:47,488 adding 'lm_eval/tasks/mmlu/default/mmlu_virology.yaml' 2026-02-14T10:26:47,490 adding 'lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml' 2026-02-14T10:26:47,530 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json' 2026-02-14T10:26:47,532 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml' 2026-02-14T10:26:47,534 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml' 2026-02-14T10:26:47,535 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml' 2026-02-14T10:26:47,536 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml' 2026-02-14T10:26:47,538 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml' 2026-02-14T10:26:47,539 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml' 2026-02-14T10:26:47,541 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:47,542 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml' 2026-02-14T10:26:47,544 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml' 2026-02-14T10:26:47,546 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml' 2026-02-14T10:26:47,547 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml' 2026-02-14T10:26:47,549 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml' 2026-02-14T10:26:47,550 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml' 2026-02-14T10:26:47,552 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml' 2026-02-14T10:26:47,553 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml' 2026-02-14T10:26:47,555 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml' 2026-02-14T10:26:47,556 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml' 2026-02-14T10:26:47,558 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:47,559 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml' 2026-02-14T10:26:47,560 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml' 2026-02-14T10:26:47,562 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml' 2026-02-14T10:26:47,564 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:47,565 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:47,568 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml' 2026-02-14T10:26:47,569 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml' 2026-02-14T10:26:47,571 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:47,572 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:47,573 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:47,575 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:47,576 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml' 2026-02-14T10:26:47,578 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml' 2026-02-14T10:26:47,579 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml' 2026-02-14T10:26:47,582 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml' 2026-02-14T10:26:47,583 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml' 2026-02-14T10:26:47,585 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml' 2026-02-14T10:26:47,586 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml' 2026-02-14T10:26:47,587 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml' 2026-02-14T10:26:47,589 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml' 2026-02-14T10:26:47,590 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml' 2026-02-14T10:26:47,592 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml' 2026-02-14T10:26:47,593 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml' 2026-02-14T10:26:47,594 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml' 2026-02-14T10:26:47,596 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml' 2026-02-14T10:26:47,597 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml' 2026-02-14T10:26:47,599 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml' 2026-02-14T10:26:47,600 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml' 2026-02-14T10:26:47,601 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml' 2026-02-14T10:26:47,603 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml' 2026-02-14T10:26:47,604 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml' 2026-02-14T10:26:47,606 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml' 2026-02-14T10:26:47,608 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml' 2026-02-14T10:26:47,609 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml' 2026-02-14T10:26:47,611 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml' 2026-02-14T10:26:47,612 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml' 2026-02-14T10:26:47,614 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml' 2026-02-14T10:26:47,615 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml' 2026-02-14T10:26:47,617 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:47,618 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml' 2026-02-14T10:26:47,619 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml' 2026-02-14T10:26:47,622 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml' 2026-02-14T10:26:47,623 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml' 2026-02-14T10:26:47,624 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml' 2026-02-14T10:26:47,626 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml' 2026-02-14T10:26:47,627 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml' 2026-02-14T10:26:47,628 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml' 2026-02-14T10:26:47,629 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:47,630 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml' 2026-02-14T10:26:47,631 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml' 2026-02-14T10:26:47,632 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml' 2026-02-14T10:26:47,633 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml' 2026-02-14T10:26:47,634 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml' 2026-02-14T10:26:47,636 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml' 2026-02-14T10:26:47,637 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml' 2026-02-14T10:26:47,638 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml' 2026-02-14T10:26:47,639 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml' 2026-02-14T10:26:47,640 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml' 2026-02-14T10:26:47,641 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:47,642 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml' 2026-02-14T10:26:47,643 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml' 2026-02-14T10:26:47,645 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml' 2026-02-14T10:26:47,646 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:47,647 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:47,648 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml' 2026-02-14T10:26:47,649 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml' 2026-02-14T10:26:47,651 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:47,652 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:47,653 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:47,654 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:47,655 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml' 2026-02-14T10:26:47,657 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml' 2026-02-14T10:26:47,658 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml' 2026-02-14T10:26:47,659 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml' 2026-02-14T10:26:47,660 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml' 2026-02-14T10:26:47,661 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml' 2026-02-14T10:26:47,662 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml' 2026-02-14T10:26:47,664 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml' 2026-02-14T10:26:47,665 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml' 2026-02-14T10:26:47,666 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml' 2026-02-14T10:26:47,667 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml' 2026-02-14T10:26:47,669 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml' 2026-02-14T10:26:47,670 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml' 2026-02-14T10:26:47,671 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml' 2026-02-14T10:26:47,672 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml' 2026-02-14T10:26:47,674 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml' 2026-02-14T10:26:47,675 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml' 2026-02-14T10:26:47,676 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml' 2026-02-14T10:26:47,677 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml' 2026-02-14T10:26:47,678 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml' 2026-02-14T10:26:47,679 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml' 2026-02-14T10:26:47,680 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml' 2026-02-14T10:26:47,681 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml' 2026-02-14T10:26:47,683 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml' 2026-02-14T10:26:47,684 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml' 2026-02-14T10:26:47,685 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml' 2026-02-14T10:26:47,686 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml' 2026-02-14T10:26:47,687 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:47,689 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml' 2026-02-14T10:26:47,690 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml' 2026-02-14T10:26:47,691 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py' 2026-02-14T10:26:47,694 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml' 2026-02-14T10:26:47,696 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml' 2026-02-14T10:26:47,697 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml' 2026-02-14T10:26:47,698 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml' 2026-02-14T10:26:47,699 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml' 2026-02-14T10:26:47,700 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml' 2026-02-14T10:26:47,702 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:47,703 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml' 2026-02-14T10:26:47,704 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml' 2026-02-14T10:26:47,705 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml' 2026-02-14T10:26:47,706 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml' 2026-02-14T10:26:47,708 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml' 2026-02-14T10:26:47,709 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml' 2026-02-14T10:26:47,710 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml' 2026-02-14T10:26:47,711 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml' 2026-02-14T10:26:47,713 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml' 2026-02-14T10:26:47,714 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml' 2026-02-14T10:26:47,715 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:47,716 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml' 2026-02-14T10:26:47,717 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml' 2026-02-14T10:26:47,718 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml' 2026-02-14T10:26:47,720 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:47,721 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:47,722 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml' 2026-02-14T10:26:47,723 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml' 2026-02-14T10:26:47,724 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:47,725 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:47,726 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:47,728 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:47,729 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml' 2026-02-14T10:26:47,730 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml' 2026-02-14T10:26:47,731 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml' 2026-02-14T10:26:47,732 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml' 2026-02-14T10:26:47,733 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml' 2026-02-14T10:26:47,734 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml' 2026-02-14T10:26:47,735 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml' 2026-02-14T10:26:47,737 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml' 2026-02-14T10:26:47,738 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml' 2026-02-14T10:26:47,739 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml' 2026-02-14T10:26:47,740 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml' 2026-02-14T10:26:47,741 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml' 2026-02-14T10:26:47,742 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml' 2026-02-14T10:26:47,743 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml' 2026-02-14T10:26:47,745 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml' 2026-02-14T10:26:47,746 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml' 2026-02-14T10:26:47,747 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml' 2026-02-14T10:26:47,748 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml' 2026-02-14T10:26:47,749 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml' 2026-02-14T10:26:47,751 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml' 2026-02-14T10:26:47,752 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml' 2026-02-14T10:26:47,753 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml' 2026-02-14T10:26:47,754 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml' 2026-02-14T10:26:47,755 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml' 2026-02-14T10:26:47,757 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml' 2026-02-14T10:26:47,758 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml' 2026-02-14T10:26:47,759 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml' 2026-02-14T10:26:47,760 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:47,761 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml' 2026-02-14T10:26:47,763 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml' 2026-02-14T10:26:47,764 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py' 2026-02-14T10:26:47,767 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml' 2026-02-14T10:26:47,768 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml' 2026-02-14T10:26:47,770 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml' 2026-02-14T10:26:47,771 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml' 2026-02-14T10:26:47,772 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml' 2026-02-14T10:26:47,773 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml' 2026-02-14T10:26:47,774 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:47,775 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml' 2026-02-14T10:26:47,776 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml' 2026-02-14T10:26:47,777 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml' 2026-02-14T10:26:47,779 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml' 2026-02-14T10:26:47,780 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml' 2026-02-14T10:26:47,781 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml' 2026-02-14T10:26:47,782 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml' 2026-02-14T10:26:47,783 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml' 2026-02-14T10:26:47,784 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml' 2026-02-14T10:26:47,786 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml' 2026-02-14T10:26:47,787 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:47,788 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml' 2026-02-14T10:26:47,789 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml' 2026-02-14T10:26:47,790 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml' 2026-02-14T10:26:47,791 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:47,792 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:47,794 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml' 2026-02-14T10:26:47,795 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml' 2026-02-14T10:26:47,796 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:47,797 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:47,798 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:47,800 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:47,801 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml' 2026-02-14T10:26:47,802 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml' 2026-02-14T10:26:47,803 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml' 2026-02-14T10:26:47,804 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml' 2026-02-14T10:26:47,806 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml' 2026-02-14T10:26:47,807 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml' 2026-02-14T10:26:47,808 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml' 2026-02-14T10:26:47,809 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml' 2026-02-14T10:26:47,810 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml' 2026-02-14T10:26:47,812 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml' 2026-02-14T10:26:47,813 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml' 2026-02-14T10:26:47,814 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml' 2026-02-14T10:26:47,815 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml' 2026-02-14T10:26:47,816 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml' 2026-02-14T10:26:47,817 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml' 2026-02-14T10:26:47,818 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml' 2026-02-14T10:26:47,819 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml' 2026-02-14T10:26:47,821 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml' 2026-02-14T10:26:47,822 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml' 2026-02-14T10:26:47,823 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml' 2026-02-14T10:26:47,824 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml' 2026-02-14T10:26:47,825 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml' 2026-02-14T10:26:47,826 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml' 2026-02-14T10:26:47,828 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml' 2026-02-14T10:26:47,829 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml' 2026-02-14T10:26:47,830 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml' 2026-02-14T10:26:47,831 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml' 2026-02-14T10:26:47,832 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:47,833 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml' 2026-02-14T10:26:47,834 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml' 2026-02-14T10:26:47,837 adding 'lm_eval/tasks/mmlu/generative/_default_template_yaml' 2026-02-14T10:26:47,839 adding 'lm_eval/tasks/mmlu/generative/_mmlu.yaml' 2026-02-14T10:26:47,840 adding 'lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml' 2026-02-14T10:26:47,841 adding 'lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml' 2026-02-14T10:26:47,842 adding 'lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml' 2026-02-14T10:26:47,843 adding 'lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml' 2026-02-14T10:26:47,845 adding 'lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:47,846 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml' 2026-02-14T10:26:47,847 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml' 2026-02-14T10:26:47,848 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml' 2026-02-14T10:26:47,849 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml' 2026-02-14T10:26:47,851 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml' 2026-02-14T10:26:47,852 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml' 2026-02-14T10:26:47,853 adding 'lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml' 2026-02-14T10:26:47,854 adding 'lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml' 2026-02-14T10:26:47,855 adding 'lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml' 2026-02-14T10:26:47,857 adding 'lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml' 2026-02-14T10:26:47,858 adding 'lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:47,859 adding 'lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml' 2026-02-14T10:26:47,860 adding 'lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml' 2026-02-14T10:26:47,862 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml' 2026-02-14T10:26:47,863 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:47,864 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:47,866 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml' 2026-02-14T10:26:47,867 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml' 2026-02-14T10:26:47,868 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:47,869 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:47,870 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:47,871 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:47,872 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml' 2026-02-14T10:26:47,873 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml' 2026-02-14T10:26:47,875 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml' 2026-02-14T10:26:47,876 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml' 2026-02-14T10:26:47,877 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml' 2026-02-14T10:26:47,878 adding 'lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml' 2026-02-14T10:26:47,880 adding 'lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml' 2026-02-14T10:26:47,881 adding 'lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml' 2026-02-14T10:26:47,882 adding 'lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml' 2026-02-14T10:26:47,883 adding 'lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml' 2026-02-14T10:26:47,884 adding 'lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml' 2026-02-14T10:26:47,885 adding 'lm_eval/tasks/mmlu/generative/mmlu_management.yaml' 2026-02-14T10:26:47,887 adding 'lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml' 2026-02-14T10:26:47,888 adding 'lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml' 2026-02-14T10:26:47,889 adding 'lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml' 2026-02-14T10:26:47,890 adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml' 2026-02-14T10:26:47,891 adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml' 2026-02-14T10:26:47,893 adding 'lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml' 2026-02-14T10:26:47,894 adding 'lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml' 2026-02-14T10:26:47,895 adding 'lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml' 2026-02-14T10:26:47,896 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml' 2026-02-14T10:26:47,897 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml' 2026-02-14T10:26:47,898 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml' 2026-02-14T10:26:47,900 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml' 2026-02-14T10:26:47,901 adding 'lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml' 2026-02-14T10:26:47,902 adding 'lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml' 2026-02-14T10:26:47,903 adding 'lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml' 2026-02-14T10:26:47,904 adding 'lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:47,906 adding 'lm_eval/tasks/mmlu/generative/mmlu_virology.yaml' 2026-02-14T10:26:47,907 adding 'lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml' 2026-02-14T10:26:47,909 adding 'lm_eval/tasks/mmlu-pro-plus/README.md' 2026-02-14T10:26:47,911 adding 'lm_eval/tasks/mmlu-pro-plus/_default_template_yaml' 2026-02-14T10:26:47,912 adding 'lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml' 2026-02-14T10:26:47,913 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml' 2026-02-14T10:26:47,914 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml' 2026-02-14T10:26:47,916 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml' 2026-02-14T10:26:47,917 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml' 2026-02-14T10:26:47,918 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml' 2026-02-14T10:26:47,919 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml' 2026-02-14T10:26:47,920 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml' 2026-02-14T10:26:47,922 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml' 2026-02-14T10:26:47,923 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml' 2026-02-14T10:26:47,924 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml' 2026-02-14T10:26:47,925 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml' 2026-02-14T10:26:47,926 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml' 2026-02-14T10:26:47,927 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml' 2026-02-14T10:26:47,929 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml' 2026-02-14T10:26:47,930 adding 'lm_eval/tasks/mmlu-pro-plus/utils.py' 2026-02-14T10:26:47,933 adding 'lm_eval/tasks/mmlu-redux/generative/README.md' 2026-02-14T10:26:47,934 adding 'lm_eval/tasks/mmlu-redux/generative/_default_template_yaml' 2026-02-14T10:26:47,936 adding 'lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml' 2026-02-14T10:26:47,937 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml' 2026-02-14T10:26:47,938 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml' 2026-02-14T10:26:47,939 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml' 2026-02-14T10:26:47,940 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml' 2026-02-14T10:26:47,941 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:47,943 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml' 2026-02-14T10:26:47,944 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml' 2026-02-14T10:26:47,945 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml' 2026-02-14T10:26:47,946 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml' 2026-02-14T10:26:47,947 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml' 2026-02-14T10:26:47,949 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml' 2026-02-14T10:26:47,950 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml' 2026-02-14T10:26:47,951 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml' 2026-02-14T10:26:47,952 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml' 2026-02-14T10:26:47,954 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml' 2026-02-14T10:26:47,955 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:47,957 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml' 2026-02-14T10:26:47,958 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml' 2026-02-14T10:26:47,959 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml' 2026-02-14T10:26:47,961 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:47,962 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:47,963 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml' 2026-02-14T10:26:47,964 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml' 2026-02-14T10:26:47,965 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:47,967 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:47,968 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:47,969 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:47,971 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml' 2026-02-14T10:26:47,972 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml' 2026-02-14T10:26:47,973 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml' 2026-02-14T10:26:47,975 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml' 2026-02-14T10:26:47,976 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml' 2026-02-14T10:26:47,977 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml' 2026-02-14T10:26:47,978 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml' 2026-02-14T10:26:47,979 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml' 2026-02-14T10:26:47,981 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml' 2026-02-14T10:26:47,982 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml' 2026-02-14T10:26:47,983 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml' 2026-02-14T10:26:47,984 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml' 2026-02-14T10:26:47,985 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml' 2026-02-14T10:26:47,986 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml' 2026-02-14T10:26:47,988 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml' 2026-02-14T10:26:47,989 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml' 2026-02-14T10:26:47,990 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml' 2026-02-14T10:26:47,991 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml' 2026-02-14T10:26:47,992 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml' 2026-02-14T10:26:47,994 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml' 2026-02-14T10:26:47,995 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml' 2026-02-14T10:26:47,996 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml' 2026-02-14T10:26:47,997 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml' 2026-02-14T10:26:47,999 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml' 2026-02-14T10:26:48,000 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml' 2026-02-14T10:26:48,001 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml' 2026-02-14T10:26:48,002 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml' 2026-02-14T10:26:48,003 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:48,004 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml' 2026-02-14T10:26:48,006 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml' 2026-02-14T10:26:48,008 adding 'lm_eval/tasks/mmlu-redux-spanish/README.md' 2026-02-14T10:26:48,009 adding 'lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml' 2026-02-14T10:26:48,012 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml' 2026-02-14T10:26:48,013 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml' 2026-02-14T10:26:48,015 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml' 2026-02-14T10:26:48,016 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml' 2026-02-14T10:26:48,017 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml' 2026-02-14T10:26:48,018 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml' 2026-02-14T10:26:48,019 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml' 2026-02-14T10:26:48,021 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml' 2026-02-14T10:26:48,022 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml' 2026-02-14T10:26:48,023 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml' 2026-02-14T10:26:48,024 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml' 2026-02-14T10:26:48,026 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml' 2026-02-14T10:26:48,027 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml' 2026-02-14T10:26:48,028 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml' 2026-02-14T10:26:48,029 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml' 2026-02-14T10:26:48,030 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml' 2026-02-14T10:26:48,031 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml' 2026-02-14T10:26:48,033 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml' 2026-02-14T10:26:48,034 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml' 2026-02-14T10:26:48,035 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml' 2026-02-14T10:26:48,036 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml' 2026-02-14T10:26:48,037 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml' 2026-02-14T10:26:48,039 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml' 2026-02-14T10:26:48,040 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml' 2026-02-14T10:26:48,041 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml' 2026-02-14T10:26:48,042 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml' 2026-02-14T10:26:48,043 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml' 2026-02-14T10:26:48,045 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml' 2026-02-14T10:26:48,046 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml' 2026-02-14T10:26:48,047 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml' 2026-02-14T10:26:48,048 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml' 2026-02-14T10:26:48,049 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml' 2026-02-14T10:26:48,051 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml' 2026-02-14T10:26:48,052 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml' 2026-02-14T10:26:48,054 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml' 2026-02-14T10:26:48,055 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml' 2026-02-14T10:26:48,056 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml' 2026-02-14T10:26:48,058 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml' 2026-02-14T10:26:48,059 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml' 2026-02-14T10:26:48,060 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml' 2026-02-14T10:26:48,061 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml' 2026-02-14T10:26:48,062 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml' 2026-02-14T10:26:48,064 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml' 2026-02-14T10:26:48,065 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml' 2026-02-14T10:26:48,066 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml' 2026-02-14T10:26:48,067 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml' 2026-02-14T10:26:48,069 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml' 2026-02-14T10:26:48,070 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml' 2026-02-14T10:26:48,071 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml' 2026-02-14T10:26:48,072 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml' 2026-02-14T10:26:48,074 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml' 2026-02-14T10:26:48,075 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml' 2026-02-14T10:26:48,076 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml' 2026-02-14T10:26:48,077 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml' 2026-02-14T10:26:48,078 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml' 2026-02-14T10:26:48,079 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml' 2026-02-14T10:26:48,081 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml' 2026-02-14T10:26:48,082 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml' 2026-02-14T10:26:48,083 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml' 2026-02-14T10:26:48,085 adding 'lm_eval/tasks/mmlu_pro/README.md' 2026-02-14T10:26:48,087 adding 'lm_eval/tasks/mmlu_pro/_default_template_yaml' 2026-02-14T10:26:48,088 adding 'lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml' 2026-02-14T10:26:48,089 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml' 2026-02-14T10:26:48,090 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml' 2026-02-14T10:26:48,092 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml' 2026-02-14T10:26:48,093 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml' 2026-02-14T10:26:48,094 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml' 2026-02-14T10:26:48,095 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml' 2026-02-14T10:26:48,096 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml' 2026-02-14T10:26:48,098 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml' 2026-02-14T10:26:48,099 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml' 2026-02-14T10:26:48,100 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml' 2026-02-14T10:26:48,101 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml' 2026-02-14T10:26:48,102 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml' 2026-02-14T10:26:48,104 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml' 2026-02-14T10:26:48,105 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml' 2026-02-14T10:26:48,106 adding 'lm_eval/tasks/mmlu_pro/utils.py' 2026-02-14T10:26:48,109 adding 'lm_eval/tasks/mmlu_prox/README.md' 2026-02-14T10:26:48,112 adding 'lm_eval/tasks/mmlu_prox/lang_libs.py' 2026-02-14T10:26:48,114 adding 'lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py' 2026-02-14T10:26:48,115 adding 'lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py' 2026-02-14T10:26:48,118 adding 'lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml' 2026-02-14T10:26:48,119 adding 'lm_eval/tasks/mmlu_prox/af/_af_template_yaml' 2026-02-14T10:26:48,120 adding 'lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml' 2026-02-14T10:26:48,122 adding 'lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml' 2026-02-14T10:26:48,123 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml' 2026-02-14T10:26:48,124 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml' 2026-02-14T10:26:48,125 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml' 2026-02-14T10:26:48,126 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml' 2026-02-14T10:26:48,128 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml' 2026-02-14T10:26:48,129 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml' 2026-02-14T10:26:48,130 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml' 2026-02-14T10:26:48,131 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml' 2026-02-14T10:26:48,132 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml' 2026-02-14T10:26:48,134 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml' 2026-02-14T10:26:48,135 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml' 2026-02-14T10:26:48,136 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml' 2026-02-14T10:26:48,137 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml' 2026-02-14T10:26:48,138 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml' 2026-02-14T10:26:48,139 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml' 2026-02-14T10:26:48,141 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml' 2026-02-14T10:26:48,142 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml' 2026-02-14T10:26:48,143 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml' 2026-02-14T10:26:48,144 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml' 2026-02-14T10:26:48,145 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml' 2026-02-14T10:26:48,146 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml' 2026-02-14T10:26:48,148 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml' 2026-02-14T10:26:48,149 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml' 2026-02-14T10:26:48,150 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml' 2026-02-14T10:26:48,151 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml' 2026-02-14T10:26:48,152 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml' 2026-02-14T10:26:48,154 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml' 2026-02-14T10:26:48,155 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml' 2026-02-14T10:26:48,156 adding 'lm_eval/tasks/mmlu_prox/af/utils.py' 2026-02-14T10:26:48,159 adding 'lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml' 2026-02-14T10:26:48,160 adding 'lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml' 2026-02-14T10:26:48,161 adding 'lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml' 2026-02-14T10:26:48,162 adding 'lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml' 2026-02-14T10:26:48,164 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml' 2026-02-14T10:26:48,165 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml' 2026-02-14T10:26:48,166 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml' 2026-02-14T10:26:48,167 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml' 2026-02-14T10:26:48,168 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml' 2026-02-14T10:26:48,170 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml' 2026-02-14T10:26:48,171 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml' 2026-02-14T10:26:48,172 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml' 2026-02-14T10:26:48,173 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml' 2026-02-14T10:26:48,175 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml' 2026-02-14T10:26:48,176 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml' 2026-02-14T10:26:48,177 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml' 2026-02-14T10:26:48,178 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml' 2026-02-14T10:26:48,180 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml' 2026-02-14T10:26:48,181 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml' 2026-02-14T10:26:48,182 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml' 2026-02-14T10:26:48,183 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml' 2026-02-14T10:26:48,185 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml' 2026-02-14T10:26:48,186 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml' 2026-02-14T10:26:48,187 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml' 2026-02-14T10:26:48,188 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml' 2026-02-14T10:26:48,190 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml' 2026-02-14T10:26:48,191 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml' 2026-02-14T10:26:48,192 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml' 2026-02-14T10:26:48,193 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml' 2026-02-14T10:26:48,195 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml' 2026-02-14T10:26:48,196 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml' 2026-02-14T10:26:48,197 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml' 2026-02-14T10:26:48,198 adding 'lm_eval/tasks/mmlu_prox/ar/utils.py' 2026-02-14T10:26:48,200 adding 'lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml' 2026-02-14T10:26:48,202 adding 'lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml' 2026-02-14T10:26:48,203 adding 'lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml' 2026-02-14T10:26:48,204 adding 'lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml' 2026-02-14T10:26:48,205 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml' 2026-02-14T10:26:48,206 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml' 2026-02-14T10:26:48,208 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml' 2026-02-14T10:26:48,209 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml' 2026-02-14T10:26:48,210 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml' 2026-02-14T10:26:48,212 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml' 2026-02-14T10:26:48,213 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml' 2026-02-14T10:26:48,214 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml' 2026-02-14T10:26:48,215 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml' 2026-02-14T10:26:48,216 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml' 2026-02-14T10:26:48,218 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml' 2026-02-14T10:26:48,219 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml' 2026-02-14T10:26:48,220 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml' 2026-02-14T10:26:48,221 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml' 2026-02-14T10:26:48,222 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml' 2026-02-14T10:26:48,224 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml' 2026-02-14T10:26:48,225 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml' 2026-02-14T10:26:48,226 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml' 2026-02-14T10:26:48,227 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml' 2026-02-14T10:26:48,229 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml' 2026-02-14T10:26:48,230 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml' 2026-02-14T10:26:48,232 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml' 2026-02-14T10:26:48,233 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml' 2026-02-14T10:26:48,234 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml' 2026-02-14T10:26:48,236 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml' 2026-02-14T10:26:48,237 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml' 2026-02-14T10:26:48,238 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml' 2026-02-14T10:26:48,239 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml' 2026-02-14T10:26:48,241 adding 'lm_eval/tasks/mmlu_prox/bn/utils.py' 2026-02-14T10:26:48,243 adding 'lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml' 2026-02-14T10:26:48,244 adding 'lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml' 2026-02-14T10:26:48,246 adding 'lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml' 2026-02-14T10:26:48,247 adding 'lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml' 2026-02-14T10:26:48,248 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml' 2026-02-14T10:26:48,249 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml' 2026-02-14T10:26:48,251 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml' 2026-02-14T10:26:48,252 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml' 2026-02-14T10:26:48,253 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml' 2026-02-14T10:26:48,255 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml' 2026-02-14T10:26:48,256 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml' 2026-02-14T10:26:48,257 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml' 2026-02-14T10:26:48,258 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml' 2026-02-14T10:26:48,259 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml' 2026-02-14T10:26:48,260 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml' 2026-02-14T10:26:48,261 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml' 2026-02-14T10:26:48,262 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml' 2026-02-14T10:26:48,263 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml' 2026-02-14T10:26:48,265 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml' 2026-02-14T10:26:48,267 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml' 2026-02-14T10:26:48,268 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml' 2026-02-14T10:26:48,269 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml' 2026-02-14T10:26:48,270 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml' 2026-02-14T10:26:48,271 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml' 2026-02-14T10:26:48,273 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml' 2026-02-14T10:26:48,274 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml' 2026-02-14T10:26:48,275 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml' 2026-02-14T10:26:48,276 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml' 2026-02-14T10:26:48,277 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml' 2026-02-14T10:26:48,279 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml' 2026-02-14T10:26:48,280 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml' 2026-02-14T10:26:48,281 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml' 2026-02-14T10:26:48,282 adding 'lm_eval/tasks/mmlu_prox/cs/utils.py' 2026-02-14T10:26:48,285 adding 'lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml' 2026-02-14T10:26:48,286 adding 'lm_eval/tasks/mmlu_prox/de/_de_template_yaml' 2026-02-14T10:26:48,287 adding 'lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml' 2026-02-14T10:26:48,289 adding 'lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml' 2026-02-14T10:26:48,290 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml' 2026-02-14T10:26:48,291 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml' 2026-02-14T10:26:48,292 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml' 2026-02-14T10:26:48,293 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml' 2026-02-14T10:26:48,295 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml' 2026-02-14T10:26:48,296 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml' 2026-02-14T10:26:48,297 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml' 2026-02-14T10:26:48,298 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml' 2026-02-14T10:26:48,300 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml' 2026-02-14T10:26:48,301 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml' 2026-02-14T10:26:48,302 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml' 2026-02-14T10:26:48,304 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml' 2026-02-14T10:26:48,305 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml' 2026-02-14T10:26:48,307 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml' 2026-02-14T10:26:48,308 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml' 2026-02-14T10:26:48,309 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml' 2026-02-14T10:26:48,311 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml' 2026-02-14T10:26:48,312 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml' 2026-02-14T10:26:48,313 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml' 2026-02-14T10:26:48,314 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml' 2026-02-14T10:26:48,315 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml' 2026-02-14T10:26:48,316 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml' 2026-02-14T10:26:48,317 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml' 2026-02-14T10:26:48,319 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml' 2026-02-14T10:26:48,320 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml' 2026-02-14T10:26:48,321 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml' 2026-02-14T10:26:48,322 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml' 2026-02-14T10:26:48,323 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml' 2026-02-14T10:26:48,325 adding 'lm_eval/tasks/mmlu_prox/de/utils.py' 2026-02-14T10:26:48,327 adding 'lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml' 2026-02-14T10:26:48,329 adding 'lm_eval/tasks/mmlu_prox/en/_en_template_yaml' 2026-02-14T10:26:48,330 adding 'lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml' 2026-02-14T10:26:48,331 adding 'lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml' 2026-02-14T10:26:48,332 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml' 2026-02-14T10:26:48,333 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml' 2026-02-14T10:26:48,334 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml' 2026-02-14T10:26:48,335 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml' 2026-02-14T10:26:48,337 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml' 2026-02-14T10:26:48,338 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml' 2026-02-14T10:26:48,339 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml' 2026-02-14T10:26:48,340 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml' 2026-02-14T10:26:48,342 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml' 2026-02-14T10:26:48,343 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml' 2026-02-14T10:26:48,344 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml' 2026-02-14T10:26:48,346 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml' 2026-02-14T10:26:48,347 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml' 2026-02-14T10:26:48,348 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml' 2026-02-14T10:26:48,349 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml' 2026-02-14T10:26:48,351 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml' 2026-02-14T10:26:48,352 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml' 2026-02-14T10:26:48,353 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml' 2026-02-14T10:26:48,354 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml' 2026-02-14T10:26:48,356 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml' 2026-02-14T10:26:48,357 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml' 2026-02-14T10:26:48,358 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml' 2026-02-14T10:26:48,359 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml' 2026-02-14T10:26:48,360 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml' 2026-02-14T10:26:48,362 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml' 2026-02-14T10:26:48,363 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml' 2026-02-14T10:26:48,364 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml' 2026-02-14T10:26:48,365 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml' 2026-02-14T10:26:48,367 adding 'lm_eval/tasks/mmlu_prox/en/utils.py' 2026-02-14T10:26:48,369 adding 'lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml' 2026-02-14T10:26:48,370 adding 'lm_eval/tasks/mmlu_prox/es/_es_template_yaml' 2026-02-14T10:26:48,371 adding 'lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml' 2026-02-14T10:26:48,372 adding 'lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml' 2026-02-14T10:26:48,373 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml' 2026-02-14T10:26:48,374 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml' 2026-02-14T10:26:48,376 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml' 2026-02-14T10:26:48,377 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml' 2026-02-14T10:26:48,378 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml' 2026-02-14T10:26:48,380 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml' 2026-02-14T10:26:48,381 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml' 2026-02-14T10:26:48,382 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml' 2026-02-14T10:26:48,383 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml' 2026-02-14T10:26:48,384 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml' 2026-02-14T10:26:48,386 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml' 2026-02-14T10:26:48,387 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml' 2026-02-14T10:26:48,389 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml' 2026-02-14T10:26:48,390 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml' 2026-02-14T10:26:48,391 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml' 2026-02-14T10:26:48,392 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml' 2026-02-14T10:26:48,394 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml' 2026-02-14T10:26:48,395 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml' 2026-02-14T10:26:48,396 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml' 2026-02-14T10:26:48,397 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml' 2026-02-14T10:26:48,398 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml' 2026-02-14T10:26:48,400 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml' 2026-02-14T10:26:48,401 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml' 2026-02-14T10:26:48,402 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml' 2026-02-14T10:26:48,403 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml' 2026-02-14T10:26:48,405 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml' 2026-02-14T10:26:48,406 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml' 2026-02-14T10:26:48,407 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml' 2026-02-14T10:26:48,408 adding 'lm_eval/tasks/mmlu_prox/es/utils.py' 2026-02-14T10:26:48,411 adding 'lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml' 2026-02-14T10:26:48,412 adding 'lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml' 2026-02-14T10:26:48,413 adding 'lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml' 2026-02-14T10:26:48,414 adding 'lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml' 2026-02-14T10:26:48,416 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml' 2026-02-14T10:26:48,417 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml' 2026-02-14T10:26:48,418 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml' 2026-02-14T10:26:48,419 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml' 2026-02-14T10:26:48,421 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml' 2026-02-14T10:26:48,422 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml' 2026-02-14T10:26:48,423 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml' 2026-02-14T10:26:48,424 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml' 2026-02-14T10:26:48,426 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml' 2026-02-14T10:26:48,427 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml' 2026-02-14T10:26:48,428 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml' 2026-02-14T10:26:48,429 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml' 2026-02-14T10:26:48,430 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml' 2026-02-14T10:26:48,432 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml' 2026-02-14T10:26:48,433 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml' 2026-02-14T10:26:48,434 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml' 2026-02-14T10:26:48,435 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml' 2026-02-14T10:26:48,436 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml' 2026-02-14T10:26:48,437 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml' 2026-02-14T10:26:48,438 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml' 2026-02-14T10:26:48,439 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml' 2026-02-14T10:26:48,441 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml' 2026-02-14T10:26:48,442 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml' 2026-02-14T10:26:48,443 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml' 2026-02-14T10:26:48,444 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml' 2026-02-14T10:26:48,445 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml' 2026-02-14T10:26:48,446 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml' 2026-02-14T10:26:48,447 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml' 2026-02-14T10:26:48,449 adding 'lm_eval/tasks/mmlu_prox/fr/utils.py' 2026-02-14T10:26:48,451 adding 'lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml' 2026-02-14T10:26:48,452 adding 'lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml' 2026-02-14T10:26:48,454 adding 'lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml' 2026-02-14T10:26:48,455 adding 'lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml' 2026-02-14T10:26:48,456 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml' 2026-02-14T10:26:48,457 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml' 2026-02-14T10:26:48,459 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml' 2026-02-14T10:26:48,460 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml' 2026-02-14T10:26:48,461 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml' 2026-02-14T10:26:48,462 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml' 2026-02-14T10:26:48,464 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml' 2026-02-14T10:26:48,465 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml' 2026-02-14T10:26:48,466 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml' 2026-02-14T10:26:48,467 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml' 2026-02-14T10:26:48,469 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml' 2026-02-14T10:26:48,470 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml' 2026-02-14T10:26:48,471 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml' 2026-02-14T10:26:48,472 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml' 2026-02-14T10:26:48,474 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml' 2026-02-14T10:26:48,475 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml' 2026-02-14T10:26:48,476 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml' 2026-02-14T10:26:48,477 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml' 2026-02-14T10:26:48,479 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml' 2026-02-14T10:26:48,480 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml' 2026-02-14T10:26:48,481 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml' 2026-02-14T10:26:48,482 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml' 2026-02-14T10:26:48,484 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml' 2026-02-14T10:26:48,485 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml' 2026-02-14T10:26:48,486 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml' 2026-02-14T10:26:48,487 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml' 2026-02-14T10:26:48,488 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml' 2026-02-14T10:26:48,489 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml' 2026-02-14T10:26:48,491 adding 'lm_eval/tasks/mmlu_prox/hi/utils.py' 2026-02-14T10:26:48,493 adding 'lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml' 2026-02-14T10:26:48,494 adding 'lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml' 2026-02-14T10:26:48,495 adding 'lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml' 2026-02-14T10:26:48,497 adding 'lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml' 2026-02-14T10:26:48,498 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml' 2026-02-14T10:26:48,499 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml' 2026-02-14T10:26:48,501 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml' 2026-02-14T10:26:48,502 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml' 2026-02-14T10:26:48,503 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml' 2026-02-14T10:26:48,504 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml' 2026-02-14T10:26:48,505 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml' 2026-02-14T10:26:48,507 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml' 2026-02-14T10:26:48,508 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml' 2026-02-14T10:26:48,509 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml' 2026-02-14T10:26:48,510 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml' 2026-02-14T10:26:48,511 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml' 2026-02-14T10:26:48,513 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml' 2026-02-14T10:26:48,514 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml' 2026-02-14T10:26:48,515 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml' 2026-02-14T10:26:48,516 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml' 2026-02-14T10:26:48,517 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml' 2026-02-14T10:26:48,519 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml' 2026-02-14T10:26:48,520 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml' 2026-02-14T10:26:48,521 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml' 2026-02-14T10:26:48,522 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml' 2026-02-14T10:26:48,523 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml' 2026-02-14T10:26:48,525 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml' 2026-02-14T10:26:48,526 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml' 2026-02-14T10:26:48,527 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml' 2026-02-14T10:26:48,528 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml' 2026-02-14T10:26:48,530 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml' 2026-02-14T10:26:48,531 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml' 2026-02-14T10:26:48,532 adding 'lm_eval/tasks/mmlu_prox/hu/utils.py' 2026-02-14T10:26:48,535 adding 'lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml' 2026-02-14T10:26:48,536 adding 'lm_eval/tasks/mmlu_prox/id/_id_template_yaml' 2026-02-14T10:26:48,537 adding 'lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml' 2026-02-14T10:26:48,538 adding 'lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml' 2026-02-14T10:26:48,540 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml' 2026-02-14T10:26:48,541 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml' 2026-02-14T10:26:48,542 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml' 2026-02-14T10:26:48,543 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml' 2026-02-14T10:26:48,544 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml' 2026-02-14T10:26:48,545 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml' 2026-02-14T10:26:48,546 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml' 2026-02-14T10:26:48,548 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml' 2026-02-14T10:26:48,549 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml' 2026-02-14T10:26:48,550 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml' 2026-02-14T10:26:48,551 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml' 2026-02-14T10:26:48,552 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml' 2026-02-14T10:26:48,553 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml' 2026-02-14T10:26:48,555 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml' 2026-02-14T10:26:48,556 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml' 2026-02-14T10:26:48,557 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml' 2026-02-14T10:26:48,558 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml' 2026-02-14T10:26:48,559 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml' 2026-02-14T10:26:48,560 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml' 2026-02-14T10:26:48,562 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml' 2026-02-14T10:26:48,563 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml' 2026-02-14T10:26:48,564 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml' 2026-02-14T10:26:48,565 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml' 2026-02-14T10:26:48,566 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml' 2026-02-14T10:26:48,567 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml' 2026-02-14T10:26:48,569 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml' 2026-02-14T10:26:48,570 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml' 2026-02-14T10:26:48,571 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml' 2026-02-14T10:26:48,572 adding 'lm_eval/tasks/mmlu_prox/id/utils.py' 2026-02-14T10:26:48,575 adding 'lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml' 2026-02-14T10:26:48,576 adding 'lm_eval/tasks/mmlu_prox/it/_it_template_yaml' 2026-02-14T10:26:48,577 adding 'lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml' 2026-02-14T10:26:48,578 adding 'lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml' 2026-02-14T10:26:48,580 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml' 2026-02-14T10:26:48,581 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml' 2026-02-14T10:26:48,582 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml' 2026-02-14T10:26:48,583 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml' 2026-02-14T10:26:48,584 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml' 2026-02-14T10:26:48,586 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml' 2026-02-14T10:26:48,587 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml' 2026-02-14T10:26:48,588 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml' 2026-02-14T10:26:48,589 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml' 2026-02-14T10:26:48,591 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml' 2026-02-14T10:26:48,592 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml' 2026-02-14T10:26:48,593 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml' 2026-02-14T10:26:48,594 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml' 2026-02-14T10:26:48,596 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml' 2026-02-14T10:26:48,597 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml' 2026-02-14T10:26:48,598 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml' 2026-02-14T10:26:48,599 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml' 2026-02-14T10:26:48,600 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml' 2026-02-14T10:26:48,601 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml' 2026-02-14T10:26:48,602 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml' 2026-02-14T10:26:48,604 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml' 2026-02-14T10:26:48,605 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml' 2026-02-14T10:26:48,606 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml' 2026-02-14T10:26:48,607 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml' 2026-02-14T10:26:48,608 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml' 2026-02-14T10:26:48,610 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml' 2026-02-14T10:26:48,611 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml' 2026-02-14T10:26:48,612 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml' 2026-02-14T10:26:48,613 adding 'lm_eval/tasks/mmlu_prox/it/utils.py' 2026-02-14T10:26:48,616 adding 'lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml' 2026-02-14T10:26:48,617 adding 'lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml' 2026-02-14T10:26:48,618 adding 'lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml' 2026-02-14T10:26:48,619 adding 'lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml' 2026-02-14T10:26:48,620 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml' 2026-02-14T10:26:48,622 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml' 2026-02-14T10:26:48,623 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml' 2026-02-14T10:26:48,624 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml' 2026-02-14T10:26:48,626 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml' 2026-02-14T10:26:48,627 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml' 2026-02-14T10:26:48,628 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml' 2026-02-14T10:26:48,629 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml' 2026-02-14T10:26:48,630 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml' 2026-02-14T10:26:48,632 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml' 2026-02-14T10:26:48,633 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml' 2026-02-14T10:26:48,634 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml' 2026-02-14T10:26:48,635 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml' 2026-02-14T10:26:48,637 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml' 2026-02-14T10:26:48,638 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml' 2026-02-14T10:26:48,639 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml' 2026-02-14T10:26:48,640 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml' 2026-02-14T10:26:48,642 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml' 2026-02-14T10:26:48,643 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml' 2026-02-14T10:26:48,644 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml' 2026-02-14T10:26:48,645 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml' 2026-02-14T10:26:48,647 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml' 2026-02-14T10:26:48,648 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml' 2026-02-14T10:26:48,649 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml' 2026-02-14T10:26:48,650 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml' 2026-02-14T10:26:48,652 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml' 2026-02-14T10:26:48,653 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml' 2026-02-14T10:26:48,654 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml' 2026-02-14T10:26:48,655 adding 'lm_eval/tasks/mmlu_prox/ja/utils.py' 2026-02-14T10:26:48,658 adding 'lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml' 2026-02-14T10:26:48,659 adding 'lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml' 2026-02-14T10:26:48,660 adding 'lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml' 2026-02-14T10:26:48,661 adding 'lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml' 2026-02-14T10:26:48,662 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml' 2026-02-14T10:26:48,663 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml' 2026-02-14T10:26:48,664 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml' 2026-02-14T10:26:48,666 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml' 2026-02-14T10:26:48,667 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml' 2026-02-14T10:26:48,668 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml' 2026-02-14T10:26:48,670 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml' 2026-02-14T10:26:48,671 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml' 2026-02-14T10:26:48,672 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml' 2026-02-14T10:26:48,673 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml' 2026-02-14T10:26:48,674 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml' 2026-02-14T10:26:48,675 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml' 2026-02-14T10:26:48,677 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml' 2026-02-14T10:26:48,678 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml' 2026-02-14T10:26:48,679 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml' 2026-02-14T10:26:48,680 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml' 2026-02-14T10:26:48,681 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml' 2026-02-14T10:26:48,683 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml' 2026-02-14T10:26:48,684 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml' 2026-02-14T10:26:48,685 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml' 2026-02-14T10:26:48,687 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml' 2026-02-14T10:26:48,688 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml' 2026-02-14T10:26:48,689 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml' 2026-02-14T10:26:48,690 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml' 2026-02-14T10:26:48,691 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml' 2026-02-14T10:26:48,693 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml' 2026-02-14T10:26:48,694 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml' 2026-02-14T10:26:48,695 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml' 2026-02-14T10:26:48,696 adding 'lm_eval/tasks/mmlu_prox/ko/utils.py' 2026-02-14T10:26:48,699 adding 'lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml' 2026-02-14T10:26:48,700 adding 'lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml' 2026-02-14T10:26:48,701 adding 'lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml' 2026-02-14T10:26:48,703 adding 'lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml' 2026-02-14T10:26:48,704 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml' 2026-02-14T10:26:48,705 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml' 2026-02-14T10:26:48,707 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml' 2026-02-14T10:26:48,708 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml' 2026-02-14T10:26:48,709 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml' 2026-02-14T10:26:48,711 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml' 2026-02-14T10:26:48,712 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml' 2026-02-14T10:26:48,713 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml' 2026-02-14T10:26:48,714 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml' 2026-02-14T10:26:48,715 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml' 2026-02-14T10:26:48,717 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml' 2026-02-14T10:26:48,718 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml' 2026-02-14T10:26:48,719 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml' 2026-02-14T10:26:48,720 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml' 2026-02-14T10:26:48,721 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml' 2026-02-14T10:26:48,723 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml' 2026-02-14T10:26:48,724 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml' 2026-02-14T10:26:48,725 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml' 2026-02-14T10:26:48,727 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml' 2026-02-14T10:26:48,728 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml' 2026-02-14T10:26:48,729 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml' 2026-02-14T10:26:48,730 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml' 2026-02-14T10:26:48,731 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml' 2026-02-14T10:26:48,732 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml' 2026-02-14T10:26:48,734 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml' 2026-02-14T10:26:48,735 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml' 2026-02-14T10:26:48,736 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml' 2026-02-14T10:26:48,737 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml' 2026-02-14T10:26:48,739 adding 'lm_eval/tasks/mmlu_prox/mr/utils.py' 2026-02-14T10:26:48,741 adding 'lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml' 2026-02-14T10:26:48,742 adding 'lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml' 2026-02-14T10:26:48,744 adding 'lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml' 2026-02-14T10:26:48,745 adding 'lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml' 2026-02-14T10:26:48,746 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml' 2026-02-14T10:26:48,747 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml' 2026-02-14T10:26:48,749 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml' 2026-02-14T10:26:48,750 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml' 2026-02-14T10:26:48,751 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml' 2026-02-14T10:26:48,752 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml' 2026-02-14T10:26:48,754 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml' 2026-02-14T10:26:48,755 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml' 2026-02-14T10:26:48,756 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml' 2026-02-14T10:26:48,758 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml' 2026-02-14T10:26:48,759 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml' 2026-02-14T10:26:48,760 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml' 2026-02-14T10:26:48,761 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml' 2026-02-14T10:26:48,763 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml' 2026-02-14T10:26:48,764 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml' 2026-02-14T10:26:48,765 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml' 2026-02-14T10:26:48,767 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml' 2026-02-14T10:26:48,768 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml' 2026-02-14T10:26:48,769 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml' 2026-02-14T10:26:48,771 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml' 2026-02-14T10:26:48,772 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml' 2026-02-14T10:26:48,773 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml' 2026-02-14T10:26:48,774 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml' 2026-02-14T10:26:48,775 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml' 2026-02-14T10:26:48,776 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml' 2026-02-14T10:26:48,778 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml' 2026-02-14T10:26:48,779 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml' 2026-02-14T10:26:48,780 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml' 2026-02-14T10:26:48,781 adding 'lm_eval/tasks/mmlu_prox/ne/utils.py' 2026-02-14T10:26:48,784 adding 'lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml' 2026-02-14T10:26:48,785 adding 'lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml' 2026-02-14T10:26:48,786 adding 'lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml' 2026-02-14T10:26:48,787 adding 'lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml' 2026-02-14T10:26:48,789 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml' 2026-02-14T10:26:48,790 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml' 2026-02-14T10:26:48,791 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml' 2026-02-14T10:26:48,792 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml' 2026-02-14T10:26:48,793 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml' 2026-02-14T10:26:48,794 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml' 2026-02-14T10:26:48,796 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml' 2026-02-14T10:26:48,797 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml' 2026-02-14T10:26:48,798 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml' 2026-02-14T10:26:48,799 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml' 2026-02-14T10:26:48,800 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml' 2026-02-14T10:26:48,802 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml' 2026-02-14T10:26:48,803 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml' 2026-02-14T10:26:48,804 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml' 2026-02-14T10:26:48,805 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml' 2026-02-14T10:26:48,806 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml' 2026-02-14T10:26:48,808 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml' 2026-02-14T10:26:48,809 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml' 2026-02-14T10:26:48,810 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml' 2026-02-14T10:26:48,811 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml' 2026-02-14T10:26:48,812 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml' 2026-02-14T10:26:48,814 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml' 2026-02-14T10:26:48,815 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml' 2026-02-14T10:26:48,816 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml' 2026-02-14T10:26:48,817 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml' 2026-02-14T10:26:48,819 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml' 2026-02-14T10:26:48,820 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml' 2026-02-14T10:26:48,821 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml' 2026-02-14T10:26:48,822 adding 'lm_eval/tasks/mmlu_prox/pt/utils.py' 2026-02-14T10:26:48,825 adding 'lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml' 2026-02-14T10:26:48,826 adding 'lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml' 2026-02-14T10:26:48,827 adding 'lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml' 2026-02-14T10:26:48,828 adding 'lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml' 2026-02-14T10:26:48,829 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml' 2026-02-14T10:26:48,831 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml' 2026-02-14T10:26:48,832 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml' 2026-02-14T10:26:48,833 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml' 2026-02-14T10:26:48,834 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml' 2026-02-14T10:26:48,835 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml' 2026-02-14T10:26:48,837 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml' 2026-02-14T10:26:48,838 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml' 2026-02-14T10:26:48,839 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml' 2026-02-14T10:26:48,840 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml' 2026-02-14T10:26:48,842 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml' 2026-02-14T10:26:48,843 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml' 2026-02-14T10:26:48,844 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml' 2026-02-14T10:26:48,845 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml' 2026-02-14T10:26:48,846 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml' 2026-02-14T10:26:48,848 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml' 2026-02-14T10:26:48,849 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml' 2026-02-14T10:26:48,850 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml' 2026-02-14T10:26:48,851 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml' 2026-02-14T10:26:48,852 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml' 2026-02-14T10:26:48,854 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml' 2026-02-14T10:26:48,855 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml' 2026-02-14T10:26:48,856 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml' 2026-02-14T10:26:48,857 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml' 2026-02-14T10:26:48,859 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml' 2026-02-14T10:26:48,860 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml' 2026-02-14T10:26:48,861 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml' 2026-02-14T10:26:48,862 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml' 2026-02-14T10:26:48,863 adding 'lm_eval/tasks/mmlu_prox/ru/utils.py' 2026-02-14T10:26:48,866 adding 'lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml' 2026-02-14T10:26:48,867 adding 'lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml' 2026-02-14T10:26:48,868 adding 'lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml' 2026-02-14T10:26:48,870 adding 'lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml' 2026-02-14T10:26:48,871 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml' 2026-02-14T10:26:48,872 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml' 2026-02-14T10:26:48,873 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml' 2026-02-14T10:26:48,874 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml' 2026-02-14T10:26:48,876 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml' 2026-02-14T10:26:48,877 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml' 2026-02-14T10:26:48,878 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml' 2026-02-14T10:26:48,879 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml' 2026-02-14T10:26:48,881 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml' 2026-02-14T10:26:48,882 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml' 2026-02-14T10:26:48,883 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml' 2026-02-14T10:26:48,884 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml' 2026-02-14T10:26:48,885 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml' 2026-02-14T10:26:48,886 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml' 2026-02-14T10:26:48,887 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml' 2026-02-14T10:26:48,889 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml' 2026-02-14T10:26:48,890 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml' 2026-02-14T10:26:48,891 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml' 2026-02-14T10:26:48,892 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml' 2026-02-14T10:26:48,893 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml' 2026-02-14T10:26:48,895 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml' 2026-02-14T10:26:48,896 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml' 2026-02-14T10:26:48,897 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml' 2026-02-14T10:26:48,898 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml' 2026-02-14T10:26:48,899 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml' 2026-02-14T10:26:48,901 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml' 2026-02-14T10:26:48,902 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml' 2026-02-14T10:26:48,903 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml' 2026-02-14T10:26:48,904 adding 'lm_eval/tasks/mmlu_prox/sr/utils.py' 2026-02-14T10:26:48,906 adding 'lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml' 2026-02-14T10:26:48,908 adding 'lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml' 2026-02-14T10:26:48,909 adding 'lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml' 2026-02-14T10:26:48,910 adding 'lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml' 2026-02-14T10:26:48,911 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml' 2026-02-14T10:26:48,912 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml' 2026-02-14T10:26:48,914 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml' 2026-02-14T10:26:48,915 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml' 2026-02-14T10:26:48,916 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml' 2026-02-14T10:26:48,917 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml' 2026-02-14T10:26:48,918 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml' 2026-02-14T10:26:48,920 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml' 2026-02-14T10:26:48,921 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml' 2026-02-14T10:26:48,922 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml' 2026-02-14T10:26:48,923 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml' 2026-02-14T10:26:48,924 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml' 2026-02-14T10:26:48,926 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml' 2026-02-14T10:26:48,927 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml' 2026-02-14T10:26:48,928 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml' 2026-02-14T10:26:48,929 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml' 2026-02-14T10:26:48,930 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml' 2026-02-14T10:26:48,932 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml' 2026-02-14T10:26:48,933 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml' 2026-02-14T10:26:48,934 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml' 2026-02-14T10:26:48,935 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml' 2026-02-14T10:26:48,937 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml' 2026-02-14T10:26:48,938 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml' 2026-02-14T10:26:48,939 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml' 2026-02-14T10:26:48,940 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml' 2026-02-14T10:26:48,941 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml' 2026-02-14T10:26:48,942 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml' 2026-02-14T10:26:48,943 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml' 2026-02-14T10:26:48,945 adding 'lm_eval/tasks/mmlu_prox/sw/utils.py' 2026-02-14T10:26:48,947 adding 'lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml' 2026-02-14T10:26:48,948 adding 'lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml' 2026-02-14T10:26:48,949 adding 'lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml' 2026-02-14T10:26:48,950 adding 'lm_eval/tasks/mmlu_prox/te/_te_template_yaml' 2026-02-14T10:26:48,952 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml' 2026-02-14T10:26:48,953 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml' 2026-02-14T10:26:48,954 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml' 2026-02-14T10:26:48,956 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml' 2026-02-14T10:26:48,957 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml' 2026-02-14T10:26:48,958 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml' 2026-02-14T10:26:48,959 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml' 2026-02-14T10:26:48,960 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml' 2026-02-14T10:26:48,962 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml' 2026-02-14T10:26:48,963 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml' 2026-02-14T10:26:48,964 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml' 2026-02-14T10:26:48,965 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml' 2026-02-14T10:26:48,966 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml' 2026-02-14T10:26:48,968 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml' 2026-02-14T10:26:48,969 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml' 2026-02-14T10:26:48,970 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml' 2026-02-14T10:26:48,971 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml' 2026-02-14T10:26:48,972 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml' 2026-02-14T10:26:48,974 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml' 2026-02-14T10:26:48,975 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml' 2026-02-14T10:26:48,976 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml' 2026-02-14T10:26:48,977 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml' 2026-02-14T10:26:48,979 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml' 2026-02-14T10:26:48,980 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml' 2026-02-14T10:26:48,981 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml' 2026-02-14T10:26:48,982 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml' 2026-02-14T10:26:48,984 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml' 2026-02-14T10:26:48,985 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml' 2026-02-14T10:26:48,986 adding 'lm_eval/tasks/mmlu_prox/te/utils.py' 2026-02-14T10:26:48,988 adding 'lm_eval/tasks/mmlu_prox/template/_lang_template_yaml' 2026-02-14T10:26:48,989 adding 'lm_eval/tasks/mmlu_prox/template/utils.py' 2026-02-14T10:26:48,992 adding 'lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml' 2026-02-14T10:26:48,993 adding 'lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml' 2026-02-14T10:26:48,994 adding 'lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml' 2026-02-14T10:26:48,996 adding 'lm_eval/tasks/mmlu_prox/th/_th_template_yaml' 2026-02-14T10:26:48,997 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml' 2026-02-14T10:26:48,998 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml' 2026-02-14T10:26:48,999 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml' 2026-02-14T10:26:49,000 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml' 2026-02-14T10:26:49,001 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml' 2026-02-14T10:26:49,002 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml' 2026-02-14T10:26:49,004 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml' 2026-02-14T10:26:49,005 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml' 2026-02-14T10:26:49,006 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml' 2026-02-14T10:26:49,007 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml' 2026-02-14T10:26:49,008 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml' 2026-02-14T10:26:49,010 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml' 2026-02-14T10:26:49,011 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml' 2026-02-14T10:26:49,012 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml' 2026-02-14T10:26:49,013 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml' 2026-02-14T10:26:49,015 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml' 2026-02-14T10:26:49,016 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml' 2026-02-14T10:26:49,017 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml' 2026-02-14T10:26:49,018 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml' 2026-02-14T10:26:49,019 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml' 2026-02-14T10:26:49,021 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml' 2026-02-14T10:26:49,022 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml' 2026-02-14T10:26:49,023 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml' 2026-02-14T10:26:49,024 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml' 2026-02-14T10:26:49,025 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml' 2026-02-14T10:26:49,027 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml' 2026-02-14T10:26:49,028 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml' 2026-02-14T10:26:49,029 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml' 2026-02-14T10:26:49,030 adding 'lm_eval/tasks/mmlu_prox/th/utils.py' 2026-02-14T10:26:49,033 adding 'lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml' 2026-02-14T10:26:49,034 adding 'lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml' 2026-02-14T10:26:49,035 adding 'lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml' 2026-02-14T10:26:49,037 adding 'lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml' 2026-02-14T10:26:49,038 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml' 2026-02-14T10:26:49,039 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml' 2026-02-14T10:26:49,040 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml' 2026-02-14T10:26:49,042 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml' 2026-02-14T10:26:49,043 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml' 2026-02-14T10:26:49,044 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml' 2026-02-14T10:26:49,045 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml' 2026-02-14T10:26:49,047 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml' 2026-02-14T10:26:49,048 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml' 2026-02-14T10:26:49,049 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml' 2026-02-14T10:26:49,050 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml' 2026-02-14T10:26:49,052 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml' 2026-02-14T10:26:49,053 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml' 2026-02-14T10:26:49,054 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml' 2026-02-14T10:26:49,055 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml' 2026-02-14T10:26:49,057 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml' 2026-02-14T10:26:49,058 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml' 2026-02-14T10:26:49,059 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml' 2026-02-14T10:26:49,060 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml' 2026-02-14T10:26:49,061 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml' 2026-02-14T10:26:49,062 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml' 2026-02-14T10:26:49,063 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml' 2026-02-14T10:26:49,065 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml' 2026-02-14T10:26:49,066 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml' 2026-02-14T10:26:49,067 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml' 2026-02-14T10:26:49,068 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml' 2026-02-14T10:26:49,070 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml' 2026-02-14T10:26:49,071 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml' 2026-02-14T10:26:49,072 adding 'lm_eval/tasks/mmlu_prox/uk/utils.py' 2026-02-14T10:26:49,074 adding 'lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml' 2026-02-14T10:26:49,076 adding 'lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml' 2026-02-14T10:26:49,077 adding 'lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml' 2026-02-14T10:26:49,078 adding 'lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml' 2026-02-14T10:26:49,079 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml' 2026-02-14T10:26:49,080 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml' 2026-02-14T10:26:49,082 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml' 2026-02-14T10:26:49,083 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml' 2026-02-14T10:26:49,084 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml' 2026-02-14T10:26:49,085 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml' 2026-02-14T10:26:49,087 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml' 2026-02-14T10:26:49,088 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml' 2026-02-14T10:26:49,089 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml' 2026-02-14T10:26:49,090 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml' 2026-02-14T10:26:49,091 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml' 2026-02-14T10:26:49,093 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml' 2026-02-14T10:26:49,094 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml' 2026-02-14T10:26:49,095 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml' 2026-02-14T10:26:49,096 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml' 2026-02-14T10:26:49,098 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml' 2026-02-14T10:26:49,099 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml' 2026-02-14T10:26:49,100 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml' 2026-02-14T10:26:49,101 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml' 2026-02-14T10:26:49,102 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml' 2026-02-14T10:26:49,104 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml' 2026-02-14T10:26:49,105 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml' 2026-02-14T10:26:49,106 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml' 2026-02-14T10:26:49,107 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml' 2026-02-14T10:26:49,109 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml' 2026-02-14T10:26:49,110 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml' 2026-02-14T10:26:49,111 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml' 2026-02-14T10:26:49,112 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml' 2026-02-14T10:26:49,113 adding 'lm_eval/tasks/mmlu_prox/ur/utils.py' 2026-02-14T10:26:49,116 adding 'lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml' 2026-02-14T10:26:49,117 adding 'lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml' 2026-02-14T10:26:49,118 adding 'lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml' 2026-02-14T10:26:49,121 adding 'lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml' 2026-02-14T10:26:49,122 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml' 2026-02-14T10:26:49,123 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml' 2026-02-14T10:26:49,124 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml' 2026-02-14T10:26:49,125 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml' 2026-02-14T10:26:49,127 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml' 2026-02-14T10:26:49,128 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml' 2026-02-14T10:26:49,129 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml' 2026-02-14T10:26:49,130 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml' 2026-02-14T10:26:49,132 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml' 2026-02-14T10:26:49,133 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml' 2026-02-14T10:26:49,134 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml' 2026-02-14T10:26:49,135 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml' 2026-02-14T10:26:49,136 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml' 2026-02-14T10:26:49,137 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml' 2026-02-14T10:26:49,139 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml' 2026-02-14T10:26:49,140 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml' 2026-02-14T10:26:49,141 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml' 2026-02-14T10:26:49,142 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml' 2026-02-14T10:26:49,143 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml' 2026-02-14T10:26:49,145 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml' 2026-02-14T10:26:49,146 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml' 2026-02-14T10:26:49,147 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml' 2026-02-14T10:26:49,148 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml' 2026-02-14T10:26:49,149 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml' 2026-02-14T10:26:49,151 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml' 2026-02-14T10:26:49,152 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml' 2026-02-14T10:26:49,153 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml' 2026-02-14T10:26:49,154 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml' 2026-02-14T10:26:49,156 adding 'lm_eval/tasks/mmlu_prox/vi/utils.py' 2026-02-14T10:26:49,158 adding 'lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml' 2026-02-14T10:26:49,159 adding 'lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml' 2026-02-14T10:26:49,161 adding 'lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml' 2026-02-14T10:26:49,162 adding 'lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml' 2026-02-14T10:26:49,163 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml' 2026-02-14T10:26:49,164 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml' 2026-02-14T10:26:49,166 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml' 2026-02-14T10:26:49,167 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml' 2026-02-14T10:26:49,168 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml' 2026-02-14T10:26:49,169 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml' 2026-02-14T10:26:49,171 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml' 2026-02-14T10:26:49,172 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml' 2026-02-14T10:26:49,173 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml' 2026-02-14T10:26:49,174 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml' 2026-02-14T10:26:49,175 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml' 2026-02-14T10:26:49,176 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml' 2026-02-14T10:26:49,177 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml' 2026-02-14T10:26:49,178 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml' 2026-02-14T10:26:49,180 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml' 2026-02-14T10:26:49,181 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml' 2026-02-14T10:26:49,182 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml' 2026-02-14T10:26:49,183 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml' 2026-02-14T10:26:49,185 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml' 2026-02-14T10:26:49,186 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml' 2026-02-14T10:26:49,187 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml' 2026-02-14T10:26:49,188 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml' 2026-02-14T10:26:49,189 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml' 2026-02-14T10:26:49,190 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml' 2026-02-14T10:26:49,191 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml' 2026-02-14T10:26:49,193 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml' 2026-02-14T10:26:49,194 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml' 2026-02-14T10:26:49,195 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml' 2026-02-14T10:26:49,196 adding 'lm_eval/tasks/mmlu_prox/wo/utils.py' 2026-02-14T10:26:49,199 adding 'lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml' 2026-02-14T10:26:49,200 adding 'lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml' 2026-02-14T10:26:49,201 adding 'lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml' 2026-02-14T10:26:49,202 adding 'lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml' 2026-02-14T10:26:49,203 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml' 2026-02-14T10:26:49,205 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml' 2026-02-14T10:26:49,206 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml' 2026-02-14T10:26:49,207 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml' 2026-02-14T10:26:49,208 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml' 2026-02-14T10:26:49,210 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml' 2026-02-14T10:26:49,211 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml' 2026-02-14T10:26:49,212 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml' 2026-02-14T10:26:49,213 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml' 2026-02-14T10:26:49,214 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml' 2026-02-14T10:26:49,216 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml' 2026-02-14T10:26:49,217 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml' 2026-02-14T10:26:49,218 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml' 2026-02-14T10:26:49,219 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml' 2026-02-14T10:26:49,221 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml' 2026-02-14T10:26:49,222 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml' 2026-02-14T10:26:49,223 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml' 2026-02-14T10:26:49,224 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml' 2026-02-14T10:26:49,226 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml' 2026-02-14T10:26:49,227 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml' 2026-02-14T10:26:49,228 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml' 2026-02-14T10:26:49,229 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml' 2026-02-14T10:26:49,230 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml' 2026-02-14T10:26:49,231 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml' 2026-02-14T10:26:49,232 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml' 2026-02-14T10:26:49,233 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml' 2026-02-14T10:26:49,235 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml' 2026-02-14T10:26:49,236 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml' 2026-02-14T10:26:49,237 adding 'lm_eval/tasks/mmlu_prox/yo/utils.py' 2026-02-14T10:26:49,239 adding 'lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml' 2026-02-14T10:26:49,240 adding 'lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml' 2026-02-14T10:26:49,242 adding 'lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml' 2026-02-14T10:26:49,243 adding 'lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml' 2026-02-14T10:26:49,244 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml' 2026-02-14T10:26:49,245 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml' 2026-02-14T10:26:49,246 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml' 2026-02-14T10:26:49,248 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml' 2026-02-14T10:26:49,249 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml' 2026-02-14T10:26:49,250 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml' 2026-02-14T10:26:49,251 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml' 2026-02-14T10:26:49,252 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml' 2026-02-14T10:26:49,254 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml' 2026-02-14T10:26:49,255 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml' 2026-02-14T10:26:49,256 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml' 2026-02-14T10:26:49,257 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml' 2026-02-14T10:26:49,259 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml' 2026-02-14T10:26:49,260 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml' 2026-02-14T10:26:49,261 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml' 2026-02-14T10:26:49,262 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml' 2026-02-14T10:26:49,263 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml' 2026-02-14T10:26:49,265 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml' 2026-02-14T10:26:49,266 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml' 2026-02-14T10:26:49,267 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml' 2026-02-14T10:26:49,268 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml' 2026-02-14T10:26:49,269 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml' 2026-02-14T10:26:49,271 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml' 2026-02-14T10:26:49,272 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml' 2026-02-14T10:26:49,273 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml' 2026-02-14T10:26:49,274 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml' 2026-02-14T10:26:49,276 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml' 2026-02-14T10:26:49,277 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml' 2026-02-14T10:26:49,278 adding 'lm_eval/tasks/mmlu_prox/zh/utils.py' 2026-02-14T10:26:49,280 adding 'lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml' 2026-02-14T10:26:49,282 adding 'lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml' 2026-02-14T10:26:49,283 adding 'lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml' 2026-02-14T10:26:49,284 adding 'lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml' 2026-02-14T10:26:49,285 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml' 2026-02-14T10:26:49,286 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml' 2026-02-14T10:26:49,287 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml' 2026-02-14T10:26:49,289 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml' 2026-02-14T10:26:49,290 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml' 2026-02-14T10:26:49,291 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml' 2026-02-14T10:26:49,292 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml' 2026-02-14T10:26:49,293 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml' 2026-02-14T10:26:49,294 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml' 2026-02-14T10:26:49,296 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml' 2026-02-14T10:26:49,297 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml' 2026-02-14T10:26:49,298 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml' 2026-02-14T10:26:49,299 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml' 2026-02-14T10:26:49,300 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml' 2026-02-14T10:26:49,301 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml' 2026-02-14T10:26:49,303 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml' 2026-02-14T10:26:49,304 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml' 2026-02-14T10:26:49,305 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml' 2026-02-14T10:26:49,306 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml' 2026-02-14T10:26:49,307 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml' 2026-02-14T10:26:49,309 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml' 2026-02-14T10:26:49,310 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml' 2026-02-14T10:26:49,311 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml' 2026-02-14T10:26:49,312 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml' 2026-02-14T10:26:49,314 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml' 2026-02-14T10:26:49,315 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml' 2026-02-14T10:26:49,316 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml' 2026-02-14T10:26:49,317 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml' 2026-02-14T10:26:49,319 adding 'lm_eval/tasks/mmlu_prox/zu/utils.py' 2026-02-14T10:26:49,321 adding 'lm_eval/tasks/mmlusr/README.md' 2026-02-14T10:26:49,322 adding 'lm_eval/tasks/mmlusr/config.py' 2026-02-14T10:26:49,325 adding 'lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml' 2026-02-14T10:26:49,326 adding 'lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml' 2026-02-14T10:26:49,328 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml' 2026-02-14T10:26:49,329 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml' 2026-02-14T10:26:49,330 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml' 2026-02-14T10:26:49,331 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml' 2026-02-14T10:26:49,332 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml' 2026-02-14T10:26:49,333 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml' 2026-02-14T10:26:49,335 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml' 2026-02-14T10:26:49,336 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml' 2026-02-14T10:26:49,337 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml' 2026-02-14T10:26:49,338 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml' 2026-02-14T10:26:49,339 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml' 2026-02-14T10:26:49,340 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml' 2026-02-14T10:26:49,342 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml' 2026-02-14T10:26:49,343 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml' 2026-02-14T10:26:49,344 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml' 2026-02-14T10:26:49,345 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml' 2026-02-14T10:26:49,346 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml' 2026-02-14T10:26:49,347 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml' 2026-02-14T10:26:49,349 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml' 2026-02-14T10:26:49,350 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml' 2026-02-14T10:26:49,351 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml' 2026-02-14T10:26:49,353 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml' 2026-02-14T10:26:49,354 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml' 2026-02-14T10:26:49,355 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml' 2026-02-14T10:26:49,356 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml' 2026-02-14T10:26:49,358 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml' 2026-02-14T10:26:49,359 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml' 2026-02-14T10:26:49,360 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml' 2026-02-14T10:26:49,361 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml' 2026-02-14T10:26:49,362 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml' 2026-02-14T10:26:49,363 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml' 2026-02-14T10:26:49,365 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml' 2026-02-14T10:26:49,366 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml' 2026-02-14T10:26:49,367 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml' 2026-02-14T10:26:49,368 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml' 2026-02-14T10:26:49,369 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml' 2026-02-14T10:26:49,370 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml' 2026-02-14T10:26:49,372 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml' 2026-02-14T10:26:49,373 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml' 2026-02-14T10:26:49,374 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml' 2026-02-14T10:26:49,375 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml' 2026-02-14T10:26:49,377 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml' 2026-02-14T10:26:49,378 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml' 2026-02-14T10:26:49,380 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml' 2026-02-14T10:26:49,381 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml' 2026-02-14T10:26:49,382 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml' 2026-02-14T10:26:49,383 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml' 2026-02-14T10:26:49,384 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml' 2026-02-14T10:26:49,386 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml' 2026-02-14T10:26:49,387 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml' 2026-02-14T10:26:49,388 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml' 2026-02-14T10:26:49,389 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml' 2026-02-14T10:26:49,390 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml' 2026-02-14T10:26:49,391 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml' 2026-02-14T10:26:49,392 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml' 2026-02-14T10:26:49,394 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml' 2026-02-14T10:26:49,395 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml' 2026-02-14T10:26:49,396 adding 'lm_eval/tasks/mmlusr/answer_only/utils.py' 2026-02-14T10:26:49,399 adding 'lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml' 2026-02-14T10:26:49,400 adding 'lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml' 2026-02-14T10:26:49,401 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml' 2026-02-14T10:26:49,403 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml' 2026-02-14T10:26:49,404 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml' 2026-02-14T10:26:49,405 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml' 2026-02-14T10:26:49,406 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml' 2026-02-14T10:26:49,408 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml' 2026-02-14T10:26:49,409 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml' 2026-02-14T10:26:49,410 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml' 2026-02-14T10:26:49,411 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml' 2026-02-14T10:26:49,412 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml' 2026-02-14T10:26:49,414 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml' 2026-02-14T10:26:49,415 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml' 2026-02-14T10:26:49,416 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml' 2026-02-14T10:26:49,417 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml' 2026-02-14T10:26:49,418 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml' 2026-02-14T10:26:49,420 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml' 2026-02-14T10:26:49,421 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml' 2026-02-14T10:26:49,422 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml' 2026-02-14T10:26:49,423 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml' 2026-02-14T10:26:49,424 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml' 2026-02-14T10:26:49,426 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml' 2026-02-14T10:26:49,427 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml' 2026-02-14T10:26:49,428 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml' 2026-02-14T10:26:49,429 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml' 2026-02-14T10:26:49,431 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml' 2026-02-14T10:26:49,432 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml' 2026-02-14T10:26:49,433 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml' 2026-02-14T10:26:49,434 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml' 2026-02-14T10:26:49,436 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml' 2026-02-14T10:26:49,437 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml' 2026-02-14T10:26:49,438 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml' 2026-02-14T10:26:49,439 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml' 2026-02-14T10:26:49,440 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml' 2026-02-14T10:26:49,441 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml' 2026-02-14T10:26:49,443 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml' 2026-02-14T10:26:49,444 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml' 2026-02-14T10:26:49,445 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml' 2026-02-14T10:26:49,446 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml' 2026-02-14T10:26:49,447 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml' 2026-02-14T10:26:49,449 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml' 2026-02-14T10:26:49,450 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml' 2026-02-14T10:26:49,451 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml' 2026-02-14T10:26:49,452 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml' 2026-02-14T10:26:49,454 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml' 2026-02-14T10:26:49,455 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml' 2026-02-14T10:26:49,456 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml' 2026-02-14T10:26:49,457 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml' 2026-02-14T10:26:49,459 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml' 2026-02-14T10:26:49,460 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml' 2026-02-14T10:26:49,461 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml' 2026-02-14T10:26:49,462 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml' 2026-02-14T10:26:49,463 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml' 2026-02-14T10:26:49,465 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml' 2026-02-14T10:26:49,466 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml' 2026-02-14T10:26:49,467 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml' 2026-02-14T10:26:49,469 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml' 2026-02-14T10:26:49,470 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml' 2026-02-14T10:26:49,471 adding 'lm_eval/tasks/mmlusr/question_and_answer/utils.py' 2026-02-14T10:26:49,474 adding 'lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml' 2026-02-14T10:26:49,475 adding 'lm_eval/tasks/mmlusr/question_only/_question_only.yaml' 2026-02-14T10:26:49,476 adding 'lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml' 2026-02-14T10:26:49,477 adding 'lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml' 2026-02-14T10:26:49,478 adding 'lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml' 2026-02-14T10:26:49,479 adding 'lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml' 2026-02-14T10:26:49,480 adding 'lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml' 2026-02-14T10:26:49,481 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml' 2026-02-14T10:26:49,482 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml' 2026-02-14T10:26:49,484 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml' 2026-02-14T10:26:49,485 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml' 2026-02-14T10:26:49,486 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml' 2026-02-14T10:26:49,487 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml' 2026-02-14T10:26:49,488 adding 'lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml' 2026-02-14T10:26:49,489 adding 'lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml' 2026-02-14T10:26:49,490 adding 'lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml' 2026-02-14T10:26:49,492 adding 'lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml' 2026-02-14T10:26:49,493 adding 'lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml' 2026-02-14T10:26:49,494 adding 'lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml' 2026-02-14T10:26:49,495 adding 'lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml' 2026-02-14T10:26:49,496 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml' 2026-02-14T10:26:49,498 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml' 2026-02-14T10:26:49,499 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml' 2026-02-14T10:26:49,500 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml' 2026-02-14T10:26:49,501 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml' 2026-02-14T10:26:49,503 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml' 2026-02-14T10:26:49,504 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml' 2026-02-14T10:26:49,505 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml' 2026-02-14T10:26:49,506 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml' 2026-02-14T10:26:49,508 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml' 2026-02-14T10:26:49,509 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml' 2026-02-14T10:26:49,510 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml' 2026-02-14T10:26:49,511 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml' 2026-02-14T10:26:49,512 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml' 2026-02-14T10:26:49,514 adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml' 2026-02-14T10:26:49,515 adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml' 2026-02-14T10:26:49,516 adding 'lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml' 2026-02-14T10:26:49,517 adding 'lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml' 2026-02-14T10:26:49,518 adding 'lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml' 2026-02-14T10:26:49,520 adding 'lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml' 2026-02-14T10:26:49,521 adding 'lm_eval/tasks/mmlusr/question_only/question_only_management.yaml' 2026-02-14T10:26:49,522 adding 'lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml' 2026-02-14T10:26:49,523 adding 'lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml' 2026-02-14T10:26:49,524 adding 'lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml' 2026-02-14T10:26:49,525 adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml' 2026-02-14T10:26:49,526 adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml' 2026-02-14T10:26:49,527 adding 'lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml' 2026-02-14T10:26:49,528 adding 'lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml' 2026-02-14T10:26:49,529 adding 'lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml' 2026-02-14T10:26:49,530 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml' 2026-02-14T10:26:49,532 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml' 2026-02-14T10:26:49,533 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml' 2026-02-14T10:26:49,534 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml' 2026-02-14T10:26:49,535 adding 'lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml' 2026-02-14T10:26:49,536 adding 'lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml' 2026-02-14T10:26:49,538 adding 'lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml' 2026-02-14T10:26:49,539 adding 'lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml' 2026-02-14T10:26:49,540 adding 'lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml' 2026-02-14T10:26:49,541 adding 'lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml' 2026-02-14T10:26:49,543 adding 'lm_eval/tasks/mmlusr/question_only/utils.py' 2026-02-14T10:26:49,546 adding 'lm_eval/tasks/mmmu/README.md' 2026-02-14T10:26:49,547 adding 'lm_eval/tasks/mmmu/_art_and_design.yaml' 2026-02-14T10:26:49,548 adding 'lm_eval/tasks/mmmu/_business.yaml' 2026-02-14T10:26:49,549 adding 'lm_eval/tasks/mmmu/_health_and_medicine.yaml' 2026-02-14T10:26:49,551 adding 'lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml' 2026-02-14T10:26:49,552 adding 'lm_eval/tasks/mmmu/_mmmu.yaml' 2026-02-14T10:26:49,553 adding 'lm_eval/tasks/mmmu/_science.yaml' 2026-02-14T10:26:49,554 adding 'lm_eval/tasks/mmmu/_tech_and_engineering.yaml' 2026-02-14T10:26:49,555 adding 'lm_eval/tasks/mmmu/_template_yaml' 2026-02-14T10:26:49,557 adding 'lm_eval/tasks/mmmu/mmmu_accounting.yaml' 2026-02-14T10:26:49,558 adding 'lm_eval/tasks/mmmu/mmmu_agriculture.yaml' 2026-02-14T10:26:49,559 adding 'lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml' 2026-02-14T10:26:49,560 adding 'lm_eval/tasks/mmmu/mmmu_art.yaml' 2026-02-14T10:26:49,561 adding 'lm_eval/tasks/mmmu/mmmu_art_theory.yaml' 2026-02-14T10:26:49,562 adding 'lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml' 2026-02-14T10:26:49,564 adding 'lm_eval/tasks/mmmu/mmmu_biology.yaml' 2026-02-14T10:26:49,565 adding 'lm_eval/tasks/mmmu/mmmu_chemistry.yaml' 2026-02-14T10:26:49,566 adding 'lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml' 2026-02-14T10:26:49,567 adding 'lm_eval/tasks/mmmu/mmmu_computer_science.yaml' 2026-02-14T10:26:49,568 adding 'lm_eval/tasks/mmmu/mmmu_design.yaml' 2026-02-14T10:26:49,569 adding 'lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml' 2026-02-14T10:26:49,570 adding 'lm_eval/tasks/mmmu/mmmu_economics.yaml' 2026-02-14T10:26:49,572 adding 'lm_eval/tasks/mmmu/mmmu_electronics.yaml' 2026-02-14T10:26:49,573 adding 'lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml' 2026-02-14T10:26:49,574 adding 'lm_eval/tasks/mmmu/mmmu_finance.yaml' 2026-02-14T10:26:49,575 adding 'lm_eval/tasks/mmmu/mmmu_geography.yaml' 2026-02-14T10:26:49,576 adding 'lm_eval/tasks/mmmu/mmmu_history.yaml' 2026-02-14T10:26:49,577 adding 'lm_eval/tasks/mmmu/mmmu_literature.yaml' 2026-02-14T10:26:49,578 adding 'lm_eval/tasks/mmmu/mmmu_manage.yaml' 2026-02-14T10:26:49,580 adding 'lm_eval/tasks/mmmu/mmmu_marketing.yaml' 2026-02-14T10:26:49,581 adding 'lm_eval/tasks/mmmu/mmmu_materials.yaml' 2026-02-14T10:26:49,582 adding 'lm_eval/tasks/mmmu/mmmu_math.yaml' 2026-02-14T10:26:49,583 adding 'lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml' 2026-02-14T10:26:49,584 adding 'lm_eval/tasks/mmmu/mmmu_music.yaml' 2026-02-14T10:26:49,585 adding 'lm_eval/tasks/mmmu/mmmu_pharmacy.yaml' 2026-02-14T10:26:49,586 adding 'lm_eval/tasks/mmmu/mmmu_physics.yaml' 2026-02-14T10:26:49,587 adding 'lm_eval/tasks/mmmu/mmmu_psychology.yaml' 2026-02-14T10:26:49,589 adding 'lm_eval/tasks/mmmu/mmmu_public_health.yaml' 2026-02-14T10:26:49,590 adding 'lm_eval/tasks/mmmu/mmmu_sociology.yaml' 2026-02-14T10:26:49,592 adding 'lm_eval/tasks/mmmu/utils.py' 2026-02-14T10:26:49,595 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py' 2026-02-14T10:26:49,597 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml' 2026-02-14T10:26:49,598 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml' 2026-02-14T10:26:49,599 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml' 2026-02-14T10:26:49,600 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml' 2026-02-14T10:26:49,601 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml' 2026-02-14T10:26:49,602 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml' 2026-02-14T10:26:49,603 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml' 2026-02-14T10:26:49,604 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml' 2026-02-14T10:26:49,606 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml' 2026-02-14T10:26:49,607 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml' 2026-02-14T10:26:49,608 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml' 2026-02-14T10:26:49,609 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml' 2026-02-14T10:26:49,610 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml' 2026-02-14T10:26:49,611 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml' 2026-02-14T10:26:49,612 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml' 2026-02-14T10:26:49,614 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml' 2026-02-14T10:26:49,615 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml' 2026-02-14T10:26:49,616 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml' 2026-02-14T10:26:49,617 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml' 2026-02-14T10:26:49,618 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml' 2026-02-14T10:26:49,619 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml' 2026-02-14T10:26:49,621 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml' 2026-02-14T10:26:49,622 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml' 2026-02-14T10:26:49,623 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml' 2026-02-14T10:26:49,624 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml' 2026-02-14T10:26:49,625 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml' 2026-02-14T10:26:49,626 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml' 2026-02-14T10:26:49,627 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml' 2026-02-14T10:26:49,628 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml' 2026-02-14T10:26:49,630 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml' 2026-02-14T10:26:49,631 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml' 2026-02-14T10:26:49,632 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml' 2026-02-14T10:26:49,633 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml' 2026-02-14T10:26:49,634 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml' 2026-02-14T10:26:49,635 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml' 2026-02-14T10:26:49,636 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml' 2026-02-14T10:26:49,637 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml' 2026-02-14T10:26:49,638 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml' 2026-02-14T10:26:49,640 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml' 2026-02-14T10:26:49,641 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml' 2026-02-14T10:26:49,642 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml' 2026-02-14T10:26:49,643 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml' 2026-02-14T10:26:49,644 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml' 2026-02-14T10:26:49,645 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml' 2026-02-14T10:26:49,646 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml' 2026-02-14T10:26:49,648 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml' 2026-02-14T10:26:49,649 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml' 2026-02-14T10:26:49,650 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml' 2026-02-14T10:26:49,651 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml' 2026-02-14T10:26:49,652 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml' 2026-02-14T10:26:49,657 adding 'lm_eval/tasks/model_written_evals/persona/_generate_configs.py' 2026-02-14T10:26:49,658 adding 'lm_eval/tasks/model_written_evals/persona/_template_yaml' 2026-02-14T10:26:49,659 adding 'lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml' 2026-02-14T10:26:49,660 adding 'lm_eval/tasks/model_written_evals/persona/agreeableness.yaml' 2026-02-14T10:26:49,661 adding 'lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml' 2026-02-14T10:26:49,662 adding 'lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml' 2026-02-14T10:26:49,664 adding 'lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml' 2026-02-14T10:26:49,665 adding 'lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml' 2026-02-14T10:26:49,666 adding 'lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml' 2026-02-14T10:26:49,667 adding 'lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml' 2026-02-14T10:26:49,668 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml' 2026-02-14T10:26:49,669 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml' 2026-02-14T10:26:49,670 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml' 2026-02-14T10:26:49,671 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml' 2026-02-14T10:26:49,673 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml' 2026-02-14T10:26:49,674 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml' 2026-02-14T10:26:49,675 adding 'lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml' 2026-02-14T10:26:49,676 adding 'lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml' 2026-02-14T10:26:49,677 adding 'lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml' 2026-02-14T10:26:49,678 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml' 2026-02-14T10:26:49,679 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml' 2026-02-14T10:26:49,680 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml' 2026-02-14T10:26:49,681 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml' 2026-02-14T10:26:49,682 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml' 2026-02-14T10:26:49,683 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml' 2026-02-14T10:26:49,685 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml' 2026-02-14T10:26:49,686 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml' 2026-02-14T10:26:49,687 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml' 2026-02-14T10:26:49,688 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml' 2026-02-14T10:26:49,689 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml' 2026-02-14T10:26:49,690 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml' 2026-02-14T10:26:49,691 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml' 2026-02-14T10:26:49,693 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml' 2026-02-14T10:26:49,694 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml' 2026-02-14T10:26:49,695 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml' 2026-02-14T10:26:49,696 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml' 2026-02-14T10:26:49,697 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml' 2026-02-14T10:26:49,698 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml' 2026-02-14T10:26:49,700 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml' 2026-02-14T10:26:49,701 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml' 2026-02-14T10:26:49,702 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml' 2026-02-14T10:26:49,703 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml' 2026-02-14T10:26:49,704 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml' 2026-02-14T10:26:49,705 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml' 2026-02-14T10:26:49,706 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml' 2026-02-14T10:26:49,708 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml' 2026-02-14T10:26:49,709 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml' 2026-02-14T10:26:49,710 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml' 2026-02-14T10:26:49,711 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml' 2026-02-14T10:26:49,712 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml' 2026-02-14T10:26:49,713 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml' 2026-02-14T10:26:49,714 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml' 2026-02-14T10:26:49,716 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml' 2026-02-14T10:26:49,717 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml' 2026-02-14T10:26:49,718 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml' 2026-02-14T10:26:49,719 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml' 2026-02-14T10:26:49,720 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml' 2026-02-14T10:26:49,721 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml' 2026-02-14T10:26:49,722 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml' 2026-02-14T10:26:49,723 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml' 2026-02-14T10:26:49,725 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml' 2026-02-14T10:26:49,726 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml' 2026-02-14T10:26:49,727 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml' 2026-02-14T10:26:49,728 adding 'lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml' 2026-02-14T10:26:49,729 adding 'lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml' 2026-02-14T10:26:49,730 adding 'lm_eval/tasks/model_written_evals/persona/extraversion.yaml' 2026-02-14T10:26:49,731 adding 'lm_eval/tasks/model_written_evals/persona/has-disability.yaml' 2026-02-14T10:26:49,733 adding 'lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml' 2026-02-14T10:26:49,734 adding 'lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml' 2026-02-14T10:26:49,735 adding 'lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml' 2026-02-14T10:26:49,736 adding 'lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml' 2026-02-14T10:26:49,737 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml' 2026-02-14T10:26:49,739 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml' 2026-02-14T10:26:49,740 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml' 2026-02-14T10:26:49,741 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml' 2026-02-14T10:26:49,742 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml' 2026-02-14T10:26:49,743 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml' 2026-02-14T10:26:49,744 adding 'lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml' 2026-02-14T10:26:49,746 adding 'lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml' 2026-02-14T10:26:49,747 adding 'lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml' 2026-02-14T10:26:49,748 adding 'lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml' 2026-02-14T10:26:49,749 adding 'lm_eval/tasks/model_written_evals/persona/narcissism.yaml' 2026-02-14T10:26:49,750 adding 'lm_eval/tasks/model_written_evals/persona/neuroticism.yaml' 2026-02-14T10:26:49,751 adding 'lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml' 2026-02-14T10:26:49,752 adding 'lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml' 2026-02-14T10:26:49,753 adding 'lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml' 2026-02-14T10:26:49,754 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml' 2026-02-14T10:26:49,755 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml' 2026-02-14T10:26:49,756 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml' 2026-02-14T10:26:49,758 adding 'lm_eval/tasks/model_written_evals/persona/openness.yaml' 2026-02-14T10:26:49,759 adding 'lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml' 2026-02-14T10:26:49,760 adding 'lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml' 2026-02-14T10:26:49,761 adding 'lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml' 2026-02-14T10:26:49,762 adding 'lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml' 2026-02-14T10:26:49,763 adding 'lm_eval/tasks/model_written_evals/persona/psychopathy.yaml' 2026-02-14T10:26:49,764 adding 'lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml' 2026-02-14T10:26:49,765 adding 'lm_eval/tasks/model_written_evals/persona/risk-averse.yaml' 2026-02-14T10:26:49,766 adding 'lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml' 2026-02-14T10:26:49,767 adding 'lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml' 2026-02-14T10:26:49,769 adding 'lm_eval/tasks/model_written_evals/persona/self-replication.yaml' 2026-02-14T10:26:49,770 adding 'lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml' 2026-02-14T10:26:49,771 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml' 2026-02-14T10:26:49,772 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml' 2026-02-14T10:26:49,773 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml' 2026-02-14T10:26:49,774 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml' 2026-02-14T10:26:49,776 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml' 2026-02-14T10:26:49,777 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml' 2026-02-14T10:26:49,778 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml' 2026-02-14T10:26:49,779 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml' 2026-02-14T10:26:49,780 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml' 2026-02-14T10:26:49,781 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml' 2026-02-14T10:26:49,783 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml' 2026-02-14T10:26:49,784 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml' 2026-02-14T10:26:49,785 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml' 2026-02-14T10:26:49,786 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml' 2026-02-14T10:26:49,787 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml' 2026-02-14T10:26:49,788 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml' 2026-02-14T10:26:49,790 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml' 2026-02-14T10:26:49,791 adding 'lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml' 2026-02-14T10:26:49,792 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml' 2026-02-14T10:26:49,794 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml' 2026-02-14T10:26:49,795 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml' 2026-02-14T10:26:49,797 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml' 2026-02-14T10:26:49,798 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml' 2026-02-14T10:26:49,799 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml' 2026-02-14T10:26:49,801 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml' 2026-02-14T10:26:49,802 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml' 2026-02-14T10:26:49,803 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml' 2026-02-14T10:26:49,805 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml' 2026-02-14T10:26:49,806 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml' 2026-02-14T10:26:49,808 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml' 2026-02-14T10:26:49,809 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml' 2026-02-14T10:26:49,811 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml' 2026-02-14T10:26:49,812 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml' 2026-02-14T10:26:49,814 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml' 2026-02-14T10:26:49,815 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml' 2026-02-14T10:26:49,817 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml' 2026-02-14T10:26:49,819 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml' 2026-02-14T10:26:49,820 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml' 2026-02-14T10:26:49,822 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml' 2026-02-14T10:26:49,824 adding 'lm_eval/tasks/model_written_evals/winogenerated/winogenerated' 2026-02-14T10:26:49,826 adding 'lm_eval/tasks/moral_stories/README.md' 2026-02-14T10:26:49,827 adding 'lm_eval/tasks/moral_stories/moral_stories.yaml' 2026-02-14T10:26:49,829 adding 'lm_eval/tasks/moral_stories/utils.py' 2026-02-14T10:26:49,831 adding 'lm_eval/tasks/mts_dialog/README.md' 2026-02-14T10:26:49,832 adding 'lm_eval/tasks/mts_dialog/mts_dialog.yaml' 2026-02-14T10:26:49,834 adding 'lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml' 2026-02-14T10:26:49,835 adding 'lm_eval/tasks/mts_dialog/utils.py' 2026-02-14T10:26:49,837 adding 'lm_eval/tasks/mts_dialog/utils_perplexity.py' 2026-02-14T10:26:49,841 adding 'lm_eval/tasks/multiblimp/README.md' 2026-02-14T10:26:49,842 adding 'lm_eval/tasks/multiblimp/_template_yaml' 2026-02-14T10:26:49,844 adding 'lm_eval/tasks/multiblimp/multiblimp_abk.yaml' 2026-02-14T10:26:49,845 adding 'lm_eval/tasks/multiblimp/multiblimp_aln.yaml' 2026-02-14T10:26:49,847 adding 'lm_eval/tasks/multiblimp/multiblimp_amh.yaml' 2026-02-14T10:26:49,848 adding 'lm_eval/tasks/multiblimp/multiblimp_apu.yaml' 2026-02-14T10:26:49,849 adding 'lm_eval/tasks/multiblimp/multiblimp_aqz.yaml' 2026-02-14T10:26:49,851 adding 'lm_eval/tasks/multiblimp/multiblimp_arb.yaml' 2026-02-14T10:26:49,852 adding 'lm_eval/tasks/multiblimp/multiblimp_azz.yaml' 2026-02-14T10:26:49,854 adding 'lm_eval/tasks/multiblimp/multiblimp_bel.yaml' 2026-02-14T10:26:49,855 adding 'lm_eval/tasks/multiblimp/multiblimp_ben.yaml' 2026-02-14T10:26:49,857 adding 'lm_eval/tasks/multiblimp/multiblimp_bho.yaml' 2026-02-14T10:26:49,858 adding 'lm_eval/tasks/multiblimp/multiblimp_bor.yaml' 2026-02-14T10:26:49,859 adding 'lm_eval/tasks/multiblimp/multiblimp_bre.yaml' 2026-02-14T10:26:49,861 adding 'lm_eval/tasks/multiblimp/multiblimp_bua.yaml' 2026-02-14T10:26:49,862 adding 'lm_eval/tasks/multiblimp/multiblimp_bul.yaml' 2026-02-14T10:26:49,864 adding 'lm_eval/tasks/multiblimp/multiblimp_cat.yaml' 2026-02-14T10:26:49,865 adding 'lm_eval/tasks/multiblimp/multiblimp_ces.yaml' 2026-02-14T10:26:49,867 adding 'lm_eval/tasks/multiblimp/multiblimp_chu.yaml' 2026-02-14T10:26:49,868 adding 'lm_eval/tasks/multiblimp/multiblimp_cym.yaml' 2026-02-14T10:26:49,869 adding 'lm_eval/tasks/multiblimp/multiblimp_dan.yaml' 2026-02-14T10:26:49,871 adding 'lm_eval/tasks/multiblimp/multiblimp_deu.yaml' 2026-02-14T10:26:49,872 adding 'lm_eval/tasks/multiblimp/multiblimp_egy.yaml' 2026-02-14T10:26:49,874 adding 'lm_eval/tasks/multiblimp/multiblimp_ell.yaml' 2026-02-14T10:26:49,875 adding 'lm_eval/tasks/multiblimp/multiblimp_eng.yaml' 2026-02-14T10:26:49,876 adding 'lm_eval/tasks/multiblimp/multiblimp_est.yaml' 2026-02-14T10:26:49,878 adding 'lm_eval/tasks/multiblimp/multiblimp_eus.yaml' 2026-02-14T10:26:49,879 adding 'lm_eval/tasks/multiblimp/multiblimp_fao.yaml' 2026-02-14T10:26:49,881 adding 'lm_eval/tasks/multiblimp/multiblimp_fas.yaml' 2026-02-14T10:26:49,882 adding 'lm_eval/tasks/multiblimp/multiblimp_fin.yaml' 2026-02-14T10:26:49,883 adding 'lm_eval/tasks/multiblimp/multiblimp_fra.yaml' 2026-02-14T10:26:49,885 adding 'lm_eval/tasks/multiblimp/multiblimp_frm.yaml' 2026-02-14T10:26:49,886 adding 'lm_eval/tasks/multiblimp/multiblimp_fro.yaml' 2026-02-14T10:26:49,888 adding 'lm_eval/tasks/multiblimp/multiblimp_gla.yaml' 2026-02-14T10:26:49,889 adding 'lm_eval/tasks/multiblimp/multiblimp_gle.yaml' 2026-02-14T10:26:49,890 adding 'lm_eval/tasks/multiblimp/multiblimp_glg.yaml' 2026-02-14T10:26:49,892 adding 'lm_eval/tasks/multiblimp/multiblimp_got.yaml' 2026-02-14T10:26:49,893 adding 'lm_eval/tasks/multiblimp/multiblimp_grc.yaml' 2026-02-14T10:26:49,894 adding 'lm_eval/tasks/multiblimp/multiblimp_guj.yaml' 2026-02-14T10:26:49,896 adding 'lm_eval/tasks/multiblimp/multiblimp_hbo.yaml' 2026-02-14T10:26:49,897 adding 'lm_eval/tasks/multiblimp/multiblimp_hbs.yaml' 2026-02-14T10:26:49,899 adding 'lm_eval/tasks/multiblimp/multiblimp_heb.yaml' 2026-02-14T10:26:49,900 adding 'lm_eval/tasks/multiblimp/multiblimp_hin.yaml' 2026-02-14T10:26:49,901 adding 'lm_eval/tasks/multiblimp/multiblimp_hit.yaml' 2026-02-14T10:26:49,903 adding 'lm_eval/tasks/multiblimp/multiblimp_hsb.yaml' 2026-02-14T10:26:49,904 adding 'lm_eval/tasks/multiblimp/multiblimp_hun.yaml' 2026-02-14T10:26:49,906 adding 'lm_eval/tasks/multiblimp/multiblimp_hye.yaml' 2026-02-14T10:26:49,907 adding 'lm_eval/tasks/multiblimp/multiblimp_hyw.yaml' 2026-02-14T10:26:49,908 adding 'lm_eval/tasks/multiblimp/multiblimp_isl.yaml' 2026-02-14T10:26:49,909 adding 'lm_eval/tasks/multiblimp/multiblimp_ita.yaml' 2026-02-14T10:26:49,911 adding 'lm_eval/tasks/multiblimp/multiblimp_kat.yaml' 2026-02-14T10:26:49,912 adding 'lm_eval/tasks/multiblimp/multiblimp_kaz.yaml' 2026-02-14T10:26:49,914 adding 'lm_eval/tasks/multiblimp/multiblimp_kir.yaml' 2026-02-14T10:26:49,915 adding 'lm_eval/tasks/multiblimp/multiblimp_kmr.yaml' 2026-02-14T10:26:49,916 adding 'lm_eval/tasks/multiblimp/multiblimp_koi.yaml' 2026-02-14T10:26:49,918 adding 'lm_eval/tasks/multiblimp/multiblimp_kpv.yaml' 2026-02-14T10:26:49,919 adding 'lm_eval/tasks/multiblimp/multiblimp_krl.yaml' 2026-02-14T10:26:49,921 adding 'lm_eval/tasks/multiblimp/multiblimp_kxh.yaml' 2026-02-14T10:26:49,922 adding 'lm_eval/tasks/multiblimp/multiblimp_lat.yaml' 2026-02-14T10:26:49,924 adding 'lm_eval/tasks/multiblimp/multiblimp_lav.yaml' 2026-02-14T10:26:49,925 adding 'lm_eval/tasks/multiblimp/multiblimp_lij.yaml' 2026-02-14T10:26:49,927 adding 'lm_eval/tasks/multiblimp/multiblimp_lit.yaml' 2026-02-14T10:26:49,928 adding 'lm_eval/tasks/multiblimp/multiblimp_mar.yaml' 2026-02-14T10:26:49,929 adding 'lm_eval/tasks/multiblimp/multiblimp_mdf.yaml' 2026-02-14T10:26:49,931 adding 'lm_eval/tasks/multiblimp/multiblimp_mkd.yaml' 2026-02-14T10:26:49,932 adding 'lm_eval/tasks/multiblimp/multiblimp_myv.yaml' 2026-02-14T10:26:49,933 adding 'lm_eval/tasks/multiblimp/multiblimp_nds.yaml' 2026-02-14T10:26:49,935 adding 'lm_eval/tasks/multiblimp/multiblimp_nhi.yaml' 2026-02-14T10:26:49,936 adding 'lm_eval/tasks/multiblimp/multiblimp_nld.yaml' 2026-02-14T10:26:49,938 adding 'lm_eval/tasks/multiblimp/multiblimp_olo.yaml' 2026-02-14T10:26:49,939 adding 'lm_eval/tasks/multiblimp/multiblimp_orv.yaml' 2026-02-14T10:26:49,941 adding 'lm_eval/tasks/multiblimp/multiblimp_ota.yaml' 2026-02-14T10:26:49,942 adding 'lm_eval/tasks/multiblimp/multiblimp_pcm.yaml' 2026-02-14T10:26:49,943 adding 'lm_eval/tasks/multiblimp/multiblimp_pol.yaml' 2026-02-14T10:26:49,945 adding 'lm_eval/tasks/multiblimp/multiblimp_por.yaml' 2026-02-14T10:26:49,946 adding 'lm_eval/tasks/multiblimp/multiblimp_quc.yaml' 2026-02-14T10:26:49,947 adding 'lm_eval/tasks/multiblimp/multiblimp_ron.yaml' 2026-02-14T10:26:49,949 adding 'lm_eval/tasks/multiblimp/multiblimp_rus.yaml' 2026-02-14T10:26:49,950 adding 'lm_eval/tasks/multiblimp/multiblimp_sah.yaml' 2026-02-14T10:26:49,951 adding 'lm_eval/tasks/multiblimp/multiblimp_san.yaml' 2026-02-14T10:26:49,953 adding 'lm_eval/tasks/multiblimp/multiblimp_slk.yaml' 2026-02-14T10:26:49,954 adding 'lm_eval/tasks/multiblimp/multiblimp_slv.yaml' 2026-02-14T10:26:49,955 adding 'lm_eval/tasks/multiblimp/multiblimp_sme.yaml' 2026-02-14T10:26:49,957 adding 'lm_eval/tasks/multiblimp/multiblimp_sms.yaml' 2026-02-14T10:26:49,958 adding 'lm_eval/tasks/multiblimp/multiblimp_spa.yaml' 2026-02-14T10:26:49,960 adding 'lm_eval/tasks/multiblimp/multiblimp_sqi.yaml' 2026-02-14T10:26:49,961 adding 'lm_eval/tasks/multiblimp/multiblimp_swe.yaml' 2026-02-14T10:26:49,963 adding 'lm_eval/tasks/multiblimp/multiblimp_tam.yaml' 2026-02-14T10:26:49,964 adding 'lm_eval/tasks/multiblimp/multiblimp_tpn.yaml' 2026-02-14T10:26:49,965 adding 'lm_eval/tasks/multiblimp/multiblimp_ttc.yaml' 2026-02-14T10:26:49,967 adding 'lm_eval/tasks/multiblimp/multiblimp_tur.yaml' 2026-02-14T10:26:49,968 adding 'lm_eval/tasks/multiblimp/multiblimp_uig.yaml' 2026-02-14T10:26:49,969 adding 'lm_eval/tasks/multiblimp/multiblimp_ukr.yaml' 2026-02-14T10:26:49,971 adding 'lm_eval/tasks/multiblimp/multiblimp_urb.yaml' 2026-02-14T10:26:49,972 adding 'lm_eval/tasks/multiblimp/multiblimp_urd.yaml' 2026-02-14T10:26:49,973 adding 'lm_eval/tasks/multiblimp/multiblimp_uzb.yaml' 2026-02-14T10:26:49,975 adding 'lm_eval/tasks/multiblimp/multiblimp_vep.yaml' 2026-02-14T10:26:49,976 adding 'lm_eval/tasks/multiblimp/multiblimp_wbp.yaml' 2026-02-14T10:26:49,977 adding 'lm_eval/tasks/multiblimp/multiblimp_wol.yaml' 2026-02-14T10:26:49,979 adding 'lm_eval/tasks/multiblimp/multiblimp_xcl.yaml' 2026-02-14T10:26:49,980 adding 'lm_eval/tasks/multiblimp/multiblimp_xnr.yaml' 2026-02-14T10:26:49,981 adding 'lm_eval/tasks/multiblimp/multiblimp_xpg.yaml' 2026-02-14T10:26:49,983 adding 'lm_eval/tasks/multiblimp/multiblimp_yrl.yaml' 2026-02-14T10:26:49,985 adding 'lm_eval/tasks/mutual/README.md' 2026-02-14T10:26:49,986 adding 'lm_eval/tasks/mutual/multual_plus.yaml' 2026-02-14T10:26:49,988 adding 'lm_eval/tasks/mutual/mutual.yaml' 2026-02-14T10:26:49,989 adding 'lm_eval/tasks/mutual/utils.py' 2026-02-14T10:26:49,992 adding 'lm_eval/tasks/noreval/README.md' 2026-02-14T10:26:50,074 adding 'lm_eval/tasks/noreval/noreval.jpg' 2026-02-14T10:26:50,080 adding 'lm_eval/tasks/noreval/ask_gec/README.md' 2026-02-14T10:26:50,082 adding 'lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml' 2026-02-14T10:26:50,083 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml' 2026-02-14T10:26:50,085 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml' 2026-02-14T10:26:50,086 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml' 2026-02-14T10:26:50,088 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml' 2026-02-14T10:26:50,089 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml' 2026-02-14T10:26:50,091 adding 'lm_eval/tasks/noreval/ask_gec/errant.py' 2026-02-14T10:26:50,093 adding 'lm_eval/tasks/noreval/ncb/ncb.yaml' 2026-02-14T10:26:50,095 adding 'lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml' 2026-02-14T10:26:50,097 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml' 2026-02-14T10:26:50,098 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml' 2026-02-14T10:26:50,099 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml' 2026-02-14T10:26:50,101 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml' 2026-02-14T10:26:50,103 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml' 2026-02-14T10:26:50,105 adding 'lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml' 2026-02-14T10:26:50,106 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml' 2026-02-14T10:26:50,108 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml' 2026-02-14T10:26:50,109 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml' 2026-02-14T10:26:50,111 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml' 2026-02-14T10:26:50,112 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml' 2026-02-14T10:26:50,114 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml' 2026-02-14T10:26:50,115 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml' 2026-02-14T10:26:50,117 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml' 2026-02-14T10:26:50,118 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml' 2026-02-14T10:26:50,120 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml' 2026-02-14T10:26:50,122 adding 'lm_eval/tasks/noreval/norec/_norec_yaml' 2026-02-14T10:26:50,123 adding 'lm_eval/tasks/noreval/norec/utils.py' 2026-02-14T10:26:50,125 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml' 2026-02-14T10:26:50,126 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml' 2026-02-14T10:26:50,128 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml' 2026-02-14T10:26:50,129 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml' 2026-02-14T10:26:50,131 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml' 2026-02-14T10:26:50,133 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml' 2026-02-14T10:26:50,134 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml' 2026-02-14T10:26:50,135 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml' 2026-02-14T10:26:50,137 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml' 2026-02-14T10:26:50,138 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml' 2026-02-14T10:26:50,140 adding 'lm_eval/tasks/noreval/noridiom/_noridiom_yaml' 2026-02-14T10:26:50,142 adding 'lm_eval/tasks/noreval/noridiom/utils.py' 2026-02-14T10:26:50,144 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml' 2026-02-14T10:26:50,145 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml' 2026-02-14T10:26:50,147 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml' 2026-02-14T10:26:50,148 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml' 2026-02-14T10:26:50,150 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml' 2026-02-14T10:26:50,151 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml' 2026-02-14T10:26:50,153 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml' 2026-02-14T10:26:50,154 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml' 2026-02-14T10:26:50,156 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml' 2026-02-14T10:26:50,157 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml' 2026-02-14T10:26:50,159 adding 'lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml' 2026-02-14T10:26:50,160 adding 'lm_eval/tasks/noreval/noropenbookqa/utils.py' 2026-02-14T10:26:50,162 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml' 2026-02-14T10:26:50,163 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml' 2026-02-14T10:26:50,165 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml' 2026-02-14T10:26:50,166 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml' 2026-02-14T10:26:50,167 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml' 2026-02-14T10:26:50,169 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml' 2026-02-14T10:26:50,170 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml' 2026-02-14T10:26:50,171 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml' 2026-02-14T10:26:50,172 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml' 2026-02-14T10:26:50,173 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml' 2026-02-14T10:26:50,175 adding 'lm_eval/tasks/noreval/norquad/_norquad_yaml' 2026-02-14T10:26:50,176 adding 'lm_eval/tasks/noreval/norquad/norquad_p0.yaml' 2026-02-14T10:26:50,177 adding 'lm_eval/tasks/noreval/norquad/norquad_p1.yaml' 2026-02-14T10:26:50,178 adding 'lm_eval/tasks/noreval/norquad/norquad_p2.yaml' 2026-02-14T10:26:50,180 adding 'lm_eval/tasks/noreval/norquad/norquad_p3.yaml' 2026-02-14T10:26:50,181 adding 'lm_eval/tasks/noreval/norquad/norquad_p4.yaml' 2026-02-14T10:26:50,182 adding 'lm_eval/tasks/noreval/norquad/utils.py' 2026-02-14T10:26:50,184 adding 'lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml' 2026-02-14T10:26:50,186 adding 'lm_eval/tasks/noreval/norsumm/_norsumm_yaml' 2026-02-14T10:26:50,187 adding 'lm_eval/tasks/noreval/norsumm/utils.py' 2026-02-14T10:26:50,189 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml' 2026-02-14T10:26:50,190 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml' 2026-02-14T10:26:50,191 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml' 2026-02-14T10:26:50,192 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml' 2026-02-14T10:26:50,194 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml' 2026-02-14T10:26:50,195 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml' 2026-02-14T10:26:50,196 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml' 2026-02-14T10:26:50,198 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml' 2026-02-14T10:26:50,199 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml' 2026-02-14T10:26:50,200 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml' 2026-02-14T10:26:50,201 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml' 2026-02-14T10:26:50,202 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml' 2026-02-14T10:26:50,204 adding 'lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml' 2026-02-14T10:26:50,206 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml' 2026-02-14T10:26:50,208 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py' 2026-02-14T10:26:50,209 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml' 2026-02-14T10:26:50,211 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml' 2026-02-14T10:26:50,212 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml' 2026-02-14T10:26:50,213 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml' 2026-02-14T10:26:50,214 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml' 2026-02-14T10:26:50,216 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml' 2026-02-14T10:26:50,217 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml' 2026-02-14T10:26:50,218 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml' 2026-02-14T10:26:50,219 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml' 2026-02-14T10:26:50,220 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml' 2026-02-14T10:26:50,222 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml' 2026-02-14T10:26:50,224 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml' 2026-02-14T10:26:50,225 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml' 2026-02-14T10:26:50,226 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml' 2026-02-14T10:26:50,227 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml' 2026-02-14T10:26:50,228 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml' 2026-02-14T10:26:50,229 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py' 2026-02-14T10:26:50,231 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml' 2026-02-14T10:26:50,232 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml' 2026-02-14T10:26:50,233 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml' 2026-02-14T10:26:50,235 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml' 2026-02-14T10:26:50,236 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml' 2026-02-14T10:26:50,237 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py' 2026-02-14T10:26:50,239 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml' 2026-02-14T10:26:50,240 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml' 2026-02-14T10:26:50,242 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml' 2026-02-14T10:26:50,243 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml' 2026-02-14T10:26:50,244 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml' 2026-02-14T10:26:50,245 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml' 2026-02-14T10:26:50,247 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py' 2026-02-14T10:26:50,248 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml' 2026-02-14T10:26:50,249 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml' 2026-02-14T10:26:50,251 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml' 2026-02-14T10:26:50,252 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml' 2026-02-14T10:26:50,253 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml' 2026-02-14T10:26:50,254 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py' 2026-02-14T10:26:50,256 adding 'lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml' 2026-02-14T10:26:50,258 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml' 2026-02-14T10:26:50,259 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml' 2026-02-14T10:26:50,260 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml' 2026-02-14T10:26:50,261 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml' 2026-02-14T10:26:50,263 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml' 2026-02-14T10:26:50,264 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml' 2026-02-14T10:26:50,266 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml' 2026-02-14T10:26:50,267 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml' 2026-02-14T10:26:50,268 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml' 2026-02-14T10:26:50,269 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml' 2026-02-14T10:26:50,271 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml' 2026-02-14T10:26:50,272 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml' 2026-02-14T10:26:50,273 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml' 2026-02-14T10:26:50,274 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml' 2026-02-14T10:26:50,276 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml' 2026-02-14T10:26:50,277 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml' 2026-02-14T10:26:50,279 adding 'lm_eval/tasks/noticia/README.md' 2026-02-14T10:26:50,280 adding 'lm_eval/tasks/noticia/noticia.yaml' 2026-02-14T10:26:50,282 adding 'lm_eval/tasks/noticia/utils.py' 2026-02-14T10:26:50,283 adding 'lm_eval/tasks/nq_open/README.md' 2026-02-14T10:26:50,285 adding 'lm_eval/tasks/nq_open/nq_open.yaml' 2026-02-14T10:26:50,288 adding 'lm_eval/tasks/okapi/arc_multilingual/README.md' 2026-02-14T10:26:50,289 adding 'lm_eval/tasks/okapi/arc_multilingual/_arc_yaml' 2026-02-14T10:26:50,290 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml' 2026-02-14T10:26:50,291 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml' 2026-02-14T10:26:50,292 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml' 2026-02-14T10:26:50,294 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml' 2026-02-14T10:26:50,295 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml' 2026-02-14T10:26:50,296 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml' 2026-02-14T10:26:50,297 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml' 2026-02-14T10:26:50,298 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml' 2026-02-14T10:26:50,299 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml' 2026-02-14T10:26:50,301 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml' 2026-02-14T10:26:50,302 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml' 2026-02-14T10:26:50,303 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml' 2026-02-14T10:26:50,304 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml' 2026-02-14T10:26:50,305 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml' 2026-02-14T10:26:50,307 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml' 2026-02-14T10:26:50,308 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml' 2026-02-14T10:26:50,309 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml' 2026-02-14T10:26:50,310 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml' 2026-02-14T10:26:50,311 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml' 2026-02-14T10:26:50,312 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml' 2026-02-14T10:26:50,313 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml' 2026-02-14T10:26:50,314 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml' 2026-02-14T10:26:50,316 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml' 2026-02-14T10:26:50,317 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml' 2026-02-14T10:26:50,318 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml' 2026-02-14T10:26:50,319 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml' 2026-02-14T10:26:50,320 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml' 2026-02-14T10:26:50,322 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml' 2026-02-14T10:26:50,323 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml' 2026-02-14T10:26:50,324 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml' 2026-02-14T10:26:50,325 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml' 2026-02-14T10:26:50,326 adding 'lm_eval/tasks/okapi/arc_multilingual/utils.py' 2026-02-14T10:26:50,328 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/README.md' 2026-02-14T10:26:50,329 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml' 2026-02-14T10:26:50,330 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml' 2026-02-14T10:26:50,332 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml' 2026-02-14T10:26:50,333 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml' 2026-02-14T10:26:50,334 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml' 2026-02-14T10:26:50,335 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml' 2026-02-14T10:26:50,336 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml' 2026-02-14T10:26:50,338 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml' 2026-02-14T10:26:50,339 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml' 2026-02-14T10:26:50,340 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml' 2026-02-14T10:26:50,341 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml' 2026-02-14T10:26:50,342 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml' 2026-02-14T10:26:50,343 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml' 2026-02-14T10:26:50,344 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml' 2026-02-14T10:26:50,345 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml' 2026-02-14T10:26:50,346 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml' 2026-02-14T10:26:50,347 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml' 2026-02-14T10:26:50,349 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml' 2026-02-14T10:26:50,350 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml' 2026-02-14T10:26:50,351 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml' 2026-02-14T10:26:50,352 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml' 2026-02-14T10:26:50,353 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml' 2026-02-14T10:26:50,354 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml' 2026-02-14T10:26:50,356 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml' 2026-02-14T10:26:50,357 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml' 2026-02-14T10:26:50,358 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml' 2026-02-14T10:26:50,359 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml' 2026-02-14T10:26:50,360 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml' 2026-02-14T10:26:50,361 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml' 2026-02-14T10:26:50,362 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml' 2026-02-14T10:26:50,364 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml' 2026-02-14T10:26:50,365 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/utils.py' 2026-02-14T10:26:50,367 adding 'lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml' 2026-02-14T10:26:50,368 adding 'lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py' 2026-02-14T10:26:50,370 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml' 2026-02-14T10:26:50,371 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml' 2026-02-14T10:26:50,372 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml' 2026-02-14T10:26:50,373 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml' 2026-02-14T10:26:50,374 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml' 2026-02-14T10:26:50,375 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml' 2026-02-14T10:26:50,377 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml' 2026-02-14T10:26:50,378 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml' 2026-02-14T10:26:50,379 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml' 2026-02-14T10:26:50,380 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml' 2026-02-14T10:26:50,381 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml' 2026-02-14T10:26:50,382 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml' 2026-02-14T10:26:50,383 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml' 2026-02-14T10:26:50,385 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml' 2026-02-14T10:26:50,386 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml' 2026-02-14T10:26:50,387 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml' 2026-02-14T10:26:50,388 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml' 2026-02-14T10:26:50,389 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml' 2026-02-14T10:26:50,390 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml' 2026-02-14T10:26:50,392 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml' 2026-02-14T10:26:50,393 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml' 2026-02-14T10:26:50,394 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml' 2026-02-14T10:26:50,395 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml' 2026-02-14T10:26:50,396 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml' 2026-02-14T10:26:50,398 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml' 2026-02-14T10:26:50,399 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml' 2026-02-14T10:26:50,400 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml' 2026-02-14T10:26:50,401 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml' 2026-02-14T10:26:50,402 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml' 2026-02-14T10:26:50,403 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml' 2026-02-14T10:26:50,405 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml' 2026-02-14T10:26:50,406 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml' 2026-02-14T10:26:50,407 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml' 2026-02-14T10:26:50,408 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml' 2026-02-14T10:26:50,411 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/README.md' 2026-02-14T10:26:50,412 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml' 2026-02-14T10:26:50,413 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml' 2026-02-14T10:26:50,415 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml' 2026-02-14T10:26:50,416 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml' 2026-02-14T10:26:50,417 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml' 2026-02-14T10:26:50,418 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml' 2026-02-14T10:26:50,419 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml' 2026-02-14T10:26:50,420 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml' 2026-02-14T10:26:50,421 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml' 2026-02-14T10:26:50,423 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml' 2026-02-14T10:26:50,424 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml' 2026-02-14T10:26:50,425 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml' 2026-02-14T10:26:50,426 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml' 2026-02-14T10:26:50,428 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml' 2026-02-14T10:26:50,429 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml' 2026-02-14T10:26:50,430 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml' 2026-02-14T10:26:50,431 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml' 2026-02-14T10:26:50,432 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml' 2026-02-14T10:26:50,433 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml' 2026-02-14T10:26:50,434 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml' 2026-02-14T10:26:50,436 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml' 2026-02-14T10:26:50,437 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml' 2026-02-14T10:26:50,438 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml' 2026-02-14T10:26:50,439 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml' 2026-02-14T10:26:50,440 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml' 2026-02-14T10:26:50,441 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml' 2026-02-14T10:26:50,442 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml' 2026-02-14T10:26:50,444 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml' 2026-02-14T10:26:50,445 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml' 2026-02-14T10:26:50,446 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml' 2026-02-14T10:26:50,447 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml' 2026-02-14T10:26:50,448 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml' 2026-02-14T10:26:50,450 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml' 2026-02-14T10:26:50,451 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml' 2026-02-14T10:26:50,452 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml' 2026-02-14T10:26:50,453 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml' 2026-02-14T10:26:50,454 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml' 2026-02-14T10:26:50,456 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml' 2026-02-14T10:26:50,457 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml' 2026-02-14T10:26:50,458 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml' 2026-02-14T10:26:50,459 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml' 2026-02-14T10:26:50,460 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml' 2026-02-14T10:26:50,462 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml' 2026-02-14T10:26:50,463 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml' 2026-02-14T10:26:50,464 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml' 2026-02-14T10:26:50,465 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml' 2026-02-14T10:26:50,467 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml' 2026-02-14T10:26:50,468 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml' 2026-02-14T10:26:50,469 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml' 2026-02-14T10:26:50,470 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml' 2026-02-14T10:26:50,471 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml' 2026-02-14T10:26:50,473 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml' 2026-02-14T10:26:50,474 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml' 2026-02-14T10:26:50,475 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml' 2026-02-14T10:26:50,476 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml' 2026-02-14T10:26:50,477 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml' 2026-02-14T10:26:50,478 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml' 2026-02-14T10:26:50,479 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml' 2026-02-14T10:26:50,481 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml' 2026-02-14T10:26:50,482 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml' 2026-02-14T10:26:50,483 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml' 2026-02-14T10:26:50,484 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml' 2026-02-14T10:26:50,485 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml' 2026-02-14T10:26:50,486 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml' 2026-02-14T10:26:50,488 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py' 2026-02-14T10:26:50,489 adding 'lm_eval/tasks/olaph/README.md' 2026-02-14T10:26:50,491 adding 'lm_eval/tasks/olaph/olaph.yaml' 2026-02-14T10:26:50,492 adding 'lm_eval/tasks/olaph/olaph_perplexity.yaml' 2026-02-14T10:26:50,493 adding 'lm_eval/tasks/olaph/utils.py' 2026-02-14T10:26:50,495 adding 'lm_eval/tasks/olaph/utils_perplexity.py' 2026-02-14T10:26:50,496 adding 'lm_eval/tasks/openai-mmmlu/README.md' 2026-02-14T10:26:50,498 adding 'lm_eval/tasks/openai-mmmlu/_generate_configs.py' 2026-02-14T10:26:50,500 adding 'lm_eval/tasks/openai-mmmlu/languages.json' 2026-02-14T10:26:50,501 adding 'lm_eval/tasks/openai-mmmlu/subjects.json' 2026-02-14T10:26:50,554 adding 'lm_eval/tasks/openai-mmmlu/default/_default_template_yaml' 2026-02-14T10:26:50,555 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu.yaml' 2026-02-14T10:26:50,556 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy.yaml' 2026-02-14T10:26:50,557 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_humanities.yaml' 2026-02-14T10:26:50,558 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_other.yaml' 2026-02-14T10:26:50,559 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_social_sciences.yaml' 2026-02-14T10:26:50,561 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_stem.yaml' 2026-02-14T10:26:50,562 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd.yaml' 2026-02-14T10:26:50,563 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_humanities.yaml' 2026-02-14T10:26:50,564 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_other.yaml' 2026-02-14T10:26:50,565 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_social_sciences.yaml' 2026-02-14T10:26:50,567 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_stem.yaml' 2026-02-14T10:26:50,568 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de.yaml' 2026-02-14T10:26:50,569 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_humanities.yaml' 2026-02-14T10:26:50,570 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_other.yaml' 2026-02-14T10:26:50,571 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_social_sciences.yaml' 2026-02-14T10:26:50,572 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_stem.yaml' 2026-02-14T10:26:50,574 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la.yaml' 2026-02-14T10:26:50,575 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_humanities.yaml' 2026-02-14T10:26:50,576 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_other.yaml' 2026-02-14T10:26:50,577 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_social_sciences.yaml' 2026-02-14T10:26:50,578 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_stem.yaml' 2026-02-14T10:26:50,580 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr.yaml' 2026-02-14T10:26:50,581 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_humanities.yaml' 2026-02-14T10:26:50,582 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_other.yaml' 2026-02-14T10:26:50,583 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_social_sciences.yaml' 2026-02-14T10:26:50,585 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_stem.yaml' 2026-02-14T10:26:50,586 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in.yaml' 2026-02-14T10:26:50,587 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_humanities.yaml' 2026-02-14T10:26:50,588 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_other.yaml' 2026-02-14T10:26:50,589 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_social_sciences.yaml' 2026-02-14T10:26:50,590 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_stem.yaml' 2026-02-14T10:26:50,592 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id.yaml' 2026-02-14T10:26:50,593 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_humanities.yaml' 2026-02-14T10:26:50,594 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_other.yaml' 2026-02-14T10:26:50,595 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_social_sciences.yaml' 2026-02-14T10:26:50,596 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_stem.yaml' 2026-02-14T10:26:50,598 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it.yaml' 2026-02-14T10:26:50,599 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_humanities.yaml' 2026-02-14T10:26:50,600 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_other.yaml' 2026-02-14T10:26:50,601 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_social_sciences.yaml' 2026-02-14T10:26:50,602 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_stem.yaml' 2026-02-14T10:26:50,603 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp.yaml' 2026-02-14T10:26:50,604 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_humanities.yaml' 2026-02-14T10:26:50,605 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_other.yaml' 2026-02-14T10:26:50,607 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_social_sciences.yaml' 2026-02-14T10:26:50,608 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_stem.yaml' 2026-02-14T10:26:50,609 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr.yaml' 2026-02-14T10:26:50,611 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_humanities.yaml' 2026-02-14T10:26:50,612 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_other.yaml' 2026-02-14T10:26:50,623 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_social_sciences.yaml' 2026-02-14T10:26:50,624 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_stem.yaml' 2026-02-14T10:26:50,624 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br.yaml' 2026-02-14T10:26:50,625 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_humanities.yaml' 2026-02-14T10:26:50,625 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_other.yaml' 2026-02-14T10:26:50,626 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_social_sciences.yaml' 2026-02-14T10:26:50,626 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_stem.yaml' 2026-02-14T10:26:50,627 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke.yaml' 2026-02-14T10:26:50,627 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_humanities.yaml' 2026-02-14T10:26:50,628 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_other.yaml' 2026-02-14T10:26:50,629 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_social_sciences.yaml' 2026-02-14T10:26:50,629 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_stem.yaml' 2026-02-14T10:26:50,630 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng.yaml' 2026-02-14T10:26:50,630 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_humanities.yaml' 2026-02-14T10:26:50,631 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_other.yaml' 2026-02-14T10:26:50,631 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_social_sciences.yaml' 2026-02-14T10:26:50,632 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_stem.yaml' 2026-02-14T10:26:50,633 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn.yaml' 2026-02-14T10:26:50,633 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_humanities.yaml' 2026-02-14T10:26:50,634 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_other.yaml' 2026-02-14T10:26:50,635 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_social_sciences.yaml' 2026-02-14T10:26:50,636 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_stem.yaml' 2026-02-14T10:26:50,638 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_abstract_algebra.yaml' 2026-02-14T10:26:50,639 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_anatomy.yaml' 2026-02-14T10:26:50,640 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_astronomy.yaml' 2026-02-14T10:26:50,641 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_business_ethics.yaml' 2026-02-14T10:26:50,642 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_clinical_knowledge.yaml' 2026-02-14T10:26:50,643 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_biology.yaml' 2026-02-14T10:26:50,645 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_chemistry.yaml' 2026-02-14T10:26:50,646 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_computer_science.yaml' 2026-02-14T10:26:50,647 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_mathematics.yaml' 2026-02-14T10:26:50,648 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_medicine.yaml' 2026-02-14T10:26:50,649 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_physics.yaml' 2026-02-14T10:26:50,651 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_computer_security.yaml' 2026-02-14T10:26:50,652 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_conceptual_physics.yaml' 2026-02-14T10:26:50,653 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_econometrics.yaml' 2026-02-14T10:26:50,654 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_electrical_engineering.yaml' 2026-02-14T10:26:50,655 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_elementary_mathematics.yaml' 2026-02-14T10:26:50,656 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_formal_logic.yaml' 2026-02-14T10:26:50,658 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_global_facts.yaml' 2026-02-14T10:26:50,659 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_biology.yaml' 2026-02-14T10:26:50,660 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_chemistry.yaml' 2026-02-14T10:26:50,661 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_computer_science.yaml' 2026-02-14T10:26:50,662 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_european_history.yaml' 2026-02-14T10:26:50,664 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_geography.yaml' 2026-02-14T10:26:50,665 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_government_and_politics.yaml' 2026-02-14T10:26:50,666 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_macroeconomics.yaml' 2026-02-14T10:26:50,667 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_mathematics.yaml' 2026-02-14T10:26:50,669 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_microeconomics.yaml' 2026-02-14T10:26:50,670 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_physics.yaml' 2026-02-14T10:26:50,671 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_psychology.yaml' 2026-02-14T10:26:50,672 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_statistics.yaml' 2026-02-14T10:26:50,673 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_us_history.yaml' 2026-02-14T10:26:50,674 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_world_history.yaml' 2026-02-14T10:26:50,676 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_aging.yaml' 2026-02-14T10:26:50,677 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_sexuality.yaml' 2026-02-14T10:26:50,678 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_international_law.yaml' 2026-02-14T10:26:50,679 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_jurisprudence.yaml' 2026-02-14T10:26:50,680 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_logical_fallacies.yaml' 2026-02-14T10:26:50,681 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_machine_learning.yaml' 2026-02-14T10:26:50,682 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_management.yaml' 2026-02-14T10:26:50,684 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_marketing.yaml' 2026-02-14T10:26:50,685 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_medical_genetics.yaml' 2026-02-14T10:26:50,686 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_miscellaneous.yaml' 2026-02-14T10:26:50,687 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_disputes.yaml' 2026-02-14T10:26:50,688 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_scenarios.yaml' 2026-02-14T10:26:50,690 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_nutrition.yaml' 2026-02-14T10:26:50,691 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_philosophy.yaml' 2026-02-14T10:26:50,692 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_prehistory.yaml' 2026-02-14T10:26:50,693 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_accounting.yaml' 2026-02-14T10:26:50,695 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_law.yaml' 2026-02-14T10:26:50,696 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_medicine.yaml' 2026-02-14T10:26:50,697 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_psychology.yaml' 2026-02-14T10:26:50,698 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_public_relations.yaml' 2026-02-14T10:26:50,699 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_security_studies.yaml' 2026-02-14T10:26:50,701 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_sociology.yaml' 2026-02-14T10:26:50,702 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_us_foreign_policy.yaml' 2026-02-14T10:26:50,703 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_virology.yaml' 2026-02-14T10:26:50,704 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_world_religions.yaml' 2026-02-14T10:26:50,705 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_abstract_algebra.yaml' 2026-02-14T10:26:50,707 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_anatomy.yaml' 2026-02-14T10:26:50,708 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_astronomy.yaml' 2026-02-14T10:26:50,709 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_business_ethics.yaml' 2026-02-14T10:26:50,710 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_clinical_knowledge.yaml' 2026-02-14T10:26:50,712 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_biology.yaml' 2026-02-14T10:26:50,713 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_chemistry.yaml' 2026-02-14T10:26:50,714 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_computer_science.yaml' 2026-02-14T10:26:50,715 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_mathematics.yaml' 2026-02-14T10:26:50,717 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_medicine.yaml' 2026-02-14T10:26:50,718 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_physics.yaml' 2026-02-14T10:26:50,719 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_computer_security.yaml' 2026-02-14T10:26:50,720 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_conceptual_physics.yaml' 2026-02-14T10:26:50,721 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_econometrics.yaml' 2026-02-14T10:26:50,723 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_electrical_engineering.yaml' 2026-02-14T10:26:50,724 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_elementary_mathematics.yaml' 2026-02-14T10:26:50,725 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_formal_logic.yaml' 2026-02-14T10:26:50,726 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_global_facts.yaml' 2026-02-14T10:26:50,727 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_biology.yaml' 2026-02-14T10:26:50,728 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_chemistry.yaml' 2026-02-14T10:26:50,730 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_computer_science.yaml' 2026-02-14T10:26:50,731 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_european_history.yaml' 2026-02-14T10:26:50,732 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_geography.yaml' 2026-02-14T10:26:50,733 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_government_and_politics.yaml' 2026-02-14T10:26:50,734 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_macroeconomics.yaml' 2026-02-14T10:26:50,736 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_mathematics.yaml' 2026-02-14T10:26:50,737 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_microeconomics.yaml' 2026-02-14T10:26:50,738 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_physics.yaml' 2026-02-14T10:26:50,739 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_psychology.yaml' 2026-02-14T10:26:50,740 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_statistics.yaml' 2026-02-14T10:26:50,741 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_us_history.yaml' 2026-02-14T10:26:50,742 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_world_history.yaml' 2026-02-14T10:26:50,744 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_aging.yaml' 2026-02-14T10:26:50,745 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_sexuality.yaml' 2026-02-14T10:26:50,746 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_international_law.yaml' 2026-02-14T10:26:50,747 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_jurisprudence.yaml' 2026-02-14T10:26:50,748 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_logical_fallacies.yaml' 2026-02-14T10:26:50,749 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_machine_learning.yaml' 2026-02-14T10:26:50,751 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_management.yaml' 2026-02-14T10:26:50,752 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_marketing.yaml' 2026-02-14T10:26:50,753 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_medical_genetics.yaml' 2026-02-14T10:26:50,754 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_miscellaneous.yaml' 2026-02-14T10:26:50,755 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_disputes.yaml' 2026-02-14T10:26:50,757 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_scenarios.yaml' 2026-02-14T10:26:50,758 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_nutrition.yaml' 2026-02-14T10:26:50,759 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_philosophy.yaml' 2026-02-14T10:26:50,760 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_prehistory.yaml' 2026-02-14T10:26:50,761 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_accounting.yaml' 2026-02-14T10:26:50,762 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_law.yaml' 2026-02-14T10:26:50,764 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_medicine.yaml' 2026-02-14T10:26:50,765 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_psychology.yaml' 2026-02-14T10:26:50,766 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_public_relations.yaml' 2026-02-14T10:26:50,767 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_security_studies.yaml' 2026-02-14T10:26:50,769 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_sociology.yaml' 2026-02-14T10:26:50,770 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_us_foreign_policy.yaml' 2026-02-14T10:26:50,771 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_virology.yaml' 2026-02-14T10:26:50,772 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_world_religions.yaml' 2026-02-14T10:26:50,773 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_abstract_algebra.yaml' 2026-02-14T10:26:50,774 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_anatomy.yaml' 2026-02-14T10:26:50,775 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_astronomy.yaml' 2026-02-14T10:26:50,777 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_business_ethics.yaml' 2026-02-14T10:26:50,778 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_clinical_knowledge.yaml' 2026-02-14T10:26:50,779 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_biology.yaml' 2026-02-14T10:26:50,780 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_chemistry.yaml' 2026-02-14T10:26:50,781 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_computer_science.yaml' 2026-02-14T10:26:50,783 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_mathematics.yaml' 2026-02-14T10:26:50,784 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_medicine.yaml' 2026-02-14T10:26:50,785 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_physics.yaml' 2026-02-14T10:26:50,787 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_computer_security.yaml' 2026-02-14T10:26:50,788 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_conceptual_physics.yaml' 2026-02-14T10:26:50,789 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_econometrics.yaml' 2026-02-14T10:26:50,790 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_electrical_engineering.yaml' 2026-02-14T10:26:50,791 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_elementary_mathematics.yaml' 2026-02-14T10:26:50,792 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_formal_logic.yaml' 2026-02-14T10:26:50,794 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_global_facts.yaml' 2026-02-14T10:26:50,795 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_biology.yaml' 2026-02-14T10:26:50,796 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_chemistry.yaml' 2026-02-14T10:26:50,797 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_computer_science.yaml' 2026-02-14T10:26:50,798 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_european_history.yaml' 2026-02-14T10:26:50,800 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_geography.yaml' 2026-02-14T10:26:50,801 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_government_and_politics.yaml' 2026-02-14T10:26:50,802 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_macroeconomics.yaml' 2026-02-14T10:26:50,803 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_mathematics.yaml' 2026-02-14T10:26:50,804 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_microeconomics.yaml' 2026-02-14T10:26:50,806 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_physics.yaml' 2026-02-14T10:26:50,807 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_psychology.yaml' 2026-02-14T10:26:50,808 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_statistics.yaml' 2026-02-14T10:26:50,809 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_us_history.yaml' 2026-02-14T10:26:50,810 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_world_history.yaml' 2026-02-14T10:26:50,812 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_aging.yaml' 2026-02-14T10:26:50,813 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_sexuality.yaml' 2026-02-14T10:26:50,814 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_international_law.yaml' 2026-02-14T10:26:50,815 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_jurisprudence.yaml' 2026-02-14T10:26:50,817 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_logical_fallacies.yaml' 2026-02-14T10:26:50,818 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_machine_learning.yaml' 2026-02-14T10:26:50,819 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_management.yaml' 2026-02-14T10:26:50,820 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_marketing.yaml' 2026-02-14T10:26:50,821 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_medical_genetics.yaml' 2026-02-14T10:26:50,822 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_miscellaneous.yaml' 2026-02-14T10:26:50,823 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_disputes.yaml' 2026-02-14T10:26:50,824 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_scenarios.yaml' 2026-02-14T10:26:50,825 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_nutrition.yaml' 2026-02-14T10:26:50,826 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_philosophy.yaml' 2026-02-14T10:26:50,828 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_prehistory.yaml' 2026-02-14T10:26:50,829 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_accounting.yaml' 2026-02-14T10:26:50,830 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_law.yaml' 2026-02-14T10:26:50,831 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_medicine.yaml' 2026-02-14T10:26:50,832 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_psychology.yaml' 2026-02-14T10:26:50,834 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_public_relations.yaml' 2026-02-14T10:26:50,835 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_security_studies.yaml' 2026-02-14T10:26:50,836 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_sociology.yaml' 2026-02-14T10:26:50,837 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_us_foreign_policy.yaml' 2026-02-14T10:26:50,839 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_virology.yaml' 2026-02-14T10:26:50,840 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_world_religions.yaml' 2026-02-14T10:26:50,841 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_abstract_algebra.yaml' 2026-02-14T10:26:50,842 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_anatomy.yaml' 2026-02-14T10:26:50,843 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_astronomy.yaml' 2026-02-14T10:26:50,844 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_business_ethics.yaml' 2026-02-14T10:26:50,846 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_clinical_knowledge.yaml' 2026-02-14T10:26:50,847 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_biology.yaml' 2026-02-14T10:26:50,848 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_chemistry.yaml' 2026-02-14T10:26:50,849 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_computer_science.yaml' 2026-02-14T10:26:50,850 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_mathematics.yaml' 2026-02-14T10:26:50,851 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_medicine.yaml' 2026-02-14T10:26:50,853 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_physics.yaml' 2026-02-14T10:26:50,854 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_computer_security.yaml' 2026-02-14T10:26:50,855 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_conceptual_physics.yaml' 2026-02-14T10:26:50,856 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_econometrics.yaml' 2026-02-14T10:26:50,858 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_electrical_engineering.yaml' 2026-02-14T10:26:50,859 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_elementary_mathematics.yaml' 2026-02-14T10:26:50,860 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_formal_logic.yaml' 2026-02-14T10:26:50,861 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_global_facts.yaml' 2026-02-14T10:26:50,862 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_biology.yaml' 2026-02-14T10:26:50,863 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_chemistry.yaml' 2026-02-14T10:26:50,865 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_computer_science.yaml' 2026-02-14T10:26:50,866 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_european_history.yaml' 2026-02-14T10:26:50,867 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_geography.yaml' 2026-02-14T10:26:50,868 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_government_and_politics.yaml' 2026-02-14T10:26:50,869 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_macroeconomics.yaml' 2026-02-14T10:26:50,870 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_mathematics.yaml' 2026-02-14T10:26:50,871 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_microeconomics.yaml' 2026-02-14T10:26:50,872 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_physics.yaml' 2026-02-14T10:26:50,874 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_psychology.yaml' 2026-02-14T10:26:50,875 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_statistics.yaml' 2026-02-14T10:26:50,876 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_us_history.yaml' 2026-02-14T10:26:50,877 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_world_history.yaml' 2026-02-14T10:26:50,878 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_aging.yaml' 2026-02-14T10:26:50,879 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_sexuality.yaml' 2026-02-14T10:26:50,880 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_international_law.yaml' 2026-02-14T10:26:50,881 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_jurisprudence.yaml' 2026-02-14T10:26:50,883 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_logical_fallacies.yaml' 2026-02-14T10:26:50,884 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_machine_learning.yaml' 2026-02-14T10:26:50,885 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_management.yaml' 2026-02-14T10:26:50,886 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_marketing.yaml' 2026-02-14T10:26:50,888 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_medical_genetics.yaml' 2026-02-14T10:26:50,889 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_miscellaneous.yaml' 2026-02-14T10:26:50,890 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_disputes.yaml' 2026-02-14T10:26:50,891 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_scenarios.yaml' 2026-02-14T10:26:50,892 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_nutrition.yaml' 2026-02-14T10:26:50,894 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_philosophy.yaml' 2026-02-14T10:26:50,895 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_prehistory.yaml' 2026-02-14T10:26:50,896 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_accounting.yaml' 2026-02-14T10:26:50,897 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_law.yaml' 2026-02-14T10:26:50,898 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_medicine.yaml' 2026-02-14T10:26:50,899 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_psychology.yaml' 2026-02-14T10:26:50,901 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_public_relations.yaml' 2026-02-14T10:26:50,902 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_security_studies.yaml' 2026-02-14T10:26:50,903 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_sociology.yaml' 2026-02-14T10:26:50,904 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_us_foreign_policy.yaml' 2026-02-14T10:26:50,905 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_virology.yaml' 2026-02-14T10:26:50,907 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_world_religions.yaml' 2026-02-14T10:26:50,908 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_abstract_algebra.yaml' 2026-02-14T10:26:50,909 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_anatomy.yaml' 2026-02-14T10:26:50,910 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_astronomy.yaml' 2026-02-14T10:26:50,912 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_business_ethics.yaml' 2026-02-14T10:26:50,913 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_clinical_knowledge.yaml' 2026-02-14T10:26:50,914 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_biology.yaml' 2026-02-14T10:26:50,915 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_chemistry.yaml' 2026-02-14T10:26:50,916 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_computer_science.yaml' 2026-02-14T10:26:50,917 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_mathematics.yaml' 2026-02-14T10:26:50,918 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_medicine.yaml' 2026-02-14T10:26:50,919 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_physics.yaml' 2026-02-14T10:26:50,921 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_computer_security.yaml' 2026-02-14T10:26:50,922 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_conceptual_physics.yaml' 2026-02-14T10:26:50,923 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_econometrics.yaml' 2026-02-14T10:26:50,924 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_electrical_engineering.yaml' 2026-02-14T10:26:50,925 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_elementary_mathematics.yaml' 2026-02-14T10:26:50,926 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_formal_logic.yaml' 2026-02-14T10:26:50,927 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_global_facts.yaml' 2026-02-14T10:26:50,928 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_biology.yaml' 2026-02-14T10:26:50,930 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_chemistry.yaml' 2026-02-14T10:26:50,931 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_computer_science.yaml' 2026-02-14T10:26:50,932 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_european_history.yaml' 2026-02-14T10:26:50,933 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_geography.yaml' 2026-02-14T10:26:50,934 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_government_and_politics.yaml' 2026-02-14T10:26:50,936 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_macroeconomics.yaml' 2026-02-14T10:26:50,937 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_mathematics.yaml' 2026-02-14T10:26:50,938 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_microeconomics.yaml' 2026-02-14T10:26:50,939 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_physics.yaml' 2026-02-14T10:26:50,940 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_psychology.yaml' 2026-02-14T10:26:50,942 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_statistics.yaml' 2026-02-14T10:26:50,943 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_us_history.yaml' 2026-02-14T10:26:50,944 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_world_history.yaml' 2026-02-14T10:26:50,945 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_aging.yaml' 2026-02-14T10:26:50,946 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_sexuality.yaml' 2026-02-14T10:26:50,948 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_international_law.yaml' 2026-02-14T10:26:50,949 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_jurisprudence.yaml' 2026-02-14T10:26:50,950 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_logical_fallacies.yaml' 2026-02-14T10:26:50,951 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_machine_learning.yaml' 2026-02-14T10:26:50,952 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_management.yaml' 2026-02-14T10:26:50,953 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_marketing.yaml' 2026-02-14T10:26:50,954 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_medical_genetics.yaml' 2026-02-14T10:26:50,956 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_miscellaneous.yaml' 2026-02-14T10:26:50,957 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_disputes.yaml' 2026-02-14T10:26:50,958 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_scenarios.yaml' 2026-02-14T10:26:50,959 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_nutrition.yaml' 2026-02-14T10:26:50,960 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_philosophy.yaml' 2026-02-14T10:26:50,961 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_prehistory.yaml' 2026-02-14T10:26:50,962 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_accounting.yaml' 2026-02-14T10:26:50,963 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_law.yaml' 2026-02-14T10:26:50,965 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_medicine.yaml' 2026-02-14T10:26:50,966 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_psychology.yaml' 2026-02-14T10:26:50,967 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_public_relations.yaml' 2026-02-14T10:26:50,968 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_security_studies.yaml' 2026-02-14T10:26:50,969 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_sociology.yaml' 2026-02-14T10:26:50,970 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_us_foreign_policy.yaml' 2026-02-14T10:26:50,971 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_virology.yaml' 2026-02-14T10:26:50,972 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_world_religions.yaml' 2026-02-14T10:26:50,974 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_abstract_algebra.yaml' 2026-02-14T10:26:50,975 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_anatomy.yaml' 2026-02-14T10:26:50,976 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_astronomy.yaml' 2026-02-14T10:26:50,977 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_business_ethics.yaml' 2026-02-14T10:26:50,978 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_clinical_knowledge.yaml' 2026-02-14T10:26:50,980 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_biology.yaml' 2026-02-14T10:26:50,981 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_chemistry.yaml' 2026-02-14T10:26:50,982 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_computer_science.yaml' 2026-02-14T10:26:50,983 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_mathematics.yaml' 2026-02-14T10:26:50,984 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_medicine.yaml' 2026-02-14T10:26:50,986 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_physics.yaml' 2026-02-14T10:26:50,987 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_computer_security.yaml' 2026-02-14T10:26:50,988 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_conceptual_physics.yaml' 2026-02-14T10:26:50,989 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_econometrics.yaml' 2026-02-14T10:26:50,990 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_electrical_engineering.yaml' 2026-02-14T10:26:50,991 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_elementary_mathematics.yaml' 2026-02-14T10:26:50,993 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_formal_logic.yaml' 2026-02-14T10:26:50,994 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_global_facts.yaml' 2026-02-14T10:26:50,995 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_biology.yaml' 2026-02-14T10:26:50,996 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_chemistry.yaml' 2026-02-14T10:26:50,997 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_computer_science.yaml' 2026-02-14T10:26:50,999 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_european_history.yaml' 2026-02-14T10:26:51,000 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_geography.yaml' 2026-02-14T10:26:51,001 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_government_and_politics.yaml' 2026-02-14T10:26:51,002 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_macroeconomics.yaml' 2026-02-14T10:26:51,003 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_mathematics.yaml' 2026-02-14T10:26:51,004 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_microeconomics.yaml' 2026-02-14T10:26:51,005 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_physics.yaml' 2026-02-14T10:26:51,006 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_psychology.yaml' 2026-02-14T10:26:51,008 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_statistics.yaml' 2026-02-14T10:26:51,009 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_us_history.yaml' 2026-02-14T10:26:51,010 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_world_history.yaml' 2026-02-14T10:26:51,011 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_aging.yaml' 2026-02-14T10:26:51,012 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_sexuality.yaml' 2026-02-14T10:26:51,013 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_international_law.yaml' 2026-02-14T10:26:51,014 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_jurisprudence.yaml' 2026-02-14T10:26:51,016 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_logical_fallacies.yaml' 2026-02-14T10:26:51,017 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_machine_learning.yaml' 2026-02-14T10:26:51,018 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_management.yaml' 2026-02-14T10:26:51,019 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_marketing.yaml' 2026-02-14T10:26:51,020 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_medical_genetics.yaml' 2026-02-14T10:26:51,021 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_miscellaneous.yaml' 2026-02-14T10:26:51,022 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_disputes.yaml' 2026-02-14T10:26:51,024 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_scenarios.yaml' 2026-02-14T10:26:51,025 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_nutrition.yaml' 2026-02-14T10:26:51,026 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_philosophy.yaml' 2026-02-14T10:26:51,027 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_prehistory.yaml' 2026-02-14T10:26:51,028 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_accounting.yaml' 2026-02-14T10:26:51,030 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_law.yaml' 2026-02-14T10:26:51,031 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_medicine.yaml' 2026-02-14T10:26:51,032 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_psychology.yaml' 2026-02-14T10:26:51,033 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_public_relations.yaml' 2026-02-14T10:26:51,034 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_security_studies.yaml' 2026-02-14T10:26:51,036 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_sociology.yaml' 2026-02-14T10:26:51,037 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_us_foreign_policy.yaml' 2026-02-14T10:26:51,038 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_virology.yaml' 2026-02-14T10:26:51,039 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_world_religions.yaml' 2026-02-14T10:26:51,040 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_abstract_algebra.yaml' 2026-02-14T10:26:51,042 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_anatomy.yaml' 2026-02-14T10:26:51,043 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_astronomy.yaml' 2026-02-14T10:26:51,044 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_business_ethics.yaml' 2026-02-14T10:26:51,045 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_clinical_knowledge.yaml' 2026-02-14T10:26:51,046 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_biology.yaml' 2026-02-14T10:26:51,047 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_chemistry.yaml' 2026-02-14T10:26:51,048 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_computer_science.yaml' 2026-02-14T10:26:51,049 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_mathematics.yaml' 2026-02-14T10:26:51,051 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_medicine.yaml' 2026-02-14T10:26:51,052 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_physics.yaml' 2026-02-14T10:26:51,053 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_computer_security.yaml' 2026-02-14T10:26:51,054 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_conceptual_physics.yaml' 2026-02-14T10:26:51,055 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_econometrics.yaml' 2026-02-14T10:26:51,056 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_electrical_engineering.yaml' 2026-02-14T10:26:51,058 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_elementary_mathematics.yaml' 2026-02-14T10:26:51,059 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_formal_logic.yaml' 2026-02-14T10:26:51,060 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_global_facts.yaml' 2026-02-14T10:26:51,061 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_biology.yaml' 2026-02-14T10:26:51,062 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_chemistry.yaml' 2026-02-14T10:26:51,063 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_computer_science.yaml' 2026-02-14T10:26:51,064 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_european_history.yaml' 2026-02-14T10:26:51,065 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_geography.yaml' 2026-02-14T10:26:51,067 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_government_and_politics.yaml' 2026-02-14T10:26:51,068 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_macroeconomics.yaml' 2026-02-14T10:26:51,069 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_mathematics.yaml' 2026-02-14T10:26:51,070 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_microeconomics.yaml' 2026-02-14T10:26:51,071 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_physics.yaml' 2026-02-14T10:26:51,072 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_psychology.yaml' 2026-02-14T10:26:51,074 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_statistics.yaml' 2026-02-14T10:26:51,075 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_us_history.yaml' 2026-02-14T10:26:51,076 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_world_history.yaml' 2026-02-14T10:26:51,077 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_aging.yaml' 2026-02-14T10:26:51,078 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_sexuality.yaml' 2026-02-14T10:26:51,080 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_international_law.yaml' 2026-02-14T10:26:51,081 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_jurisprudence.yaml' 2026-02-14T10:26:51,082 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_logical_fallacies.yaml' 2026-02-14T10:26:51,083 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_machine_learning.yaml' 2026-02-14T10:26:51,084 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_management.yaml' 2026-02-14T10:26:51,085 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_marketing.yaml' 2026-02-14T10:26:51,087 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_medical_genetics.yaml' 2026-02-14T10:26:51,088 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_miscellaneous.yaml' 2026-02-14T10:26:51,089 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_disputes.yaml' 2026-02-14T10:26:51,090 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_scenarios.yaml' 2026-02-14T10:26:51,091 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_nutrition.yaml' 2026-02-14T10:26:51,092 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_philosophy.yaml' 2026-02-14T10:26:51,093 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_prehistory.yaml' 2026-02-14T10:26:51,094 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_accounting.yaml' 2026-02-14T10:26:51,095 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_law.yaml' 2026-02-14T10:26:51,097 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_medicine.yaml' 2026-02-14T10:26:51,098 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_psychology.yaml' 2026-02-14T10:26:51,099 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_public_relations.yaml' 2026-02-14T10:26:51,100 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_security_studies.yaml' 2026-02-14T10:26:51,101 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_sociology.yaml' 2026-02-14T10:26:51,102 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_us_foreign_policy.yaml' 2026-02-14T10:26:51,103 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_virology.yaml' 2026-02-14T10:26:51,105 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_world_religions.yaml' 2026-02-14T10:26:51,106 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_abstract_algebra.yaml' 2026-02-14T10:26:51,107 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_anatomy.yaml' 2026-02-14T10:26:51,108 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_astronomy.yaml' 2026-02-14T10:26:51,109 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_business_ethics.yaml' 2026-02-14T10:26:51,111 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_clinical_knowledge.yaml' 2026-02-14T10:26:51,112 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_biology.yaml' 2026-02-14T10:26:51,113 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_chemistry.yaml' 2026-02-14T10:26:51,114 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_computer_science.yaml' 2026-02-14T10:26:51,115 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_mathematics.yaml' 2026-02-14T10:26:51,116 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_medicine.yaml' 2026-02-14T10:26:51,118 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_physics.yaml' 2026-02-14T10:26:51,119 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_computer_security.yaml' 2026-02-14T10:26:51,120 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_conceptual_physics.yaml' 2026-02-14T10:26:51,121 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_econometrics.yaml' 2026-02-14T10:26:51,122 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_electrical_engineering.yaml' 2026-02-14T10:26:51,124 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_elementary_mathematics.yaml' 2026-02-14T10:26:51,125 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_formal_logic.yaml' 2026-02-14T10:26:51,126 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_global_facts.yaml' 2026-02-14T10:26:51,127 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_biology.yaml' 2026-02-14T10:26:51,128 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_chemistry.yaml' 2026-02-14T10:26:51,130 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_computer_science.yaml' 2026-02-14T10:26:51,131 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_european_history.yaml' 2026-02-14T10:26:51,132 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_geography.yaml' 2026-02-14T10:26:51,133 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_government_and_politics.yaml' 2026-02-14T10:26:51,134 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_macroeconomics.yaml' 2026-02-14T10:26:51,136 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_mathematics.yaml' 2026-02-14T10:26:51,137 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_microeconomics.yaml' 2026-02-14T10:26:51,138 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_physics.yaml' 2026-02-14T10:26:51,139 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_psychology.yaml' 2026-02-14T10:26:51,140 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_statistics.yaml' 2026-02-14T10:26:51,141 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_us_history.yaml' 2026-02-14T10:26:51,142 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_world_history.yaml' 2026-02-14T10:26:51,143 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_aging.yaml' 2026-02-14T10:26:51,144 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_sexuality.yaml' 2026-02-14T10:26:51,145 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_international_law.yaml' 2026-02-14T10:26:51,146 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_jurisprudence.yaml' 2026-02-14T10:26:51,148 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_logical_fallacies.yaml' 2026-02-14T10:26:51,149 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_machine_learning.yaml' 2026-02-14T10:26:51,150 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_management.yaml' 2026-02-14T10:26:51,151 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_marketing.yaml' 2026-02-14T10:26:51,152 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_medical_genetics.yaml' 2026-02-14T10:26:51,153 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_miscellaneous.yaml' 2026-02-14T10:26:51,154 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_disputes.yaml' 2026-02-14T10:26:51,156 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_scenarios.yaml' 2026-02-14T10:26:51,157 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_nutrition.yaml' 2026-02-14T10:26:51,158 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_philosophy.yaml' 2026-02-14T10:26:51,159 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_prehistory.yaml' 2026-02-14T10:26:51,160 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_accounting.yaml' 2026-02-14T10:26:51,161 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_law.yaml' 2026-02-14T10:26:51,163 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_medicine.yaml' 2026-02-14T10:26:51,164 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_psychology.yaml' 2026-02-14T10:26:51,165 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_public_relations.yaml' 2026-02-14T10:26:51,166 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_security_studies.yaml' 2026-02-14T10:26:51,168 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_sociology.yaml' 2026-02-14T10:26:51,169 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_us_foreign_policy.yaml' 2026-02-14T10:26:51,170 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_virology.yaml' 2026-02-14T10:26:51,171 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_world_religions.yaml' 2026-02-14T10:26:51,172 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_abstract_algebra.yaml' 2026-02-14T10:26:51,174 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_anatomy.yaml' 2026-02-14T10:26:51,175 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_astronomy.yaml' 2026-02-14T10:26:51,176 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_business_ethics.yaml' 2026-02-14T10:26:51,177 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_clinical_knowledge.yaml' 2026-02-14T10:26:51,178 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_biology.yaml' 2026-02-14T10:26:51,180 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_chemistry.yaml' 2026-02-14T10:26:51,181 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_computer_science.yaml' 2026-02-14T10:26:51,182 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_mathematics.yaml' 2026-02-14T10:26:51,183 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_medicine.yaml' 2026-02-14T10:26:51,184 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_physics.yaml' 2026-02-14T10:26:51,185 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_computer_security.yaml' 2026-02-14T10:26:51,186 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_conceptual_physics.yaml' 2026-02-14T10:26:51,187 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_econometrics.yaml' 2026-02-14T10:26:51,188 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_electrical_engineering.yaml' 2026-02-14T10:26:51,190 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_elementary_mathematics.yaml' 2026-02-14T10:26:51,191 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_formal_logic.yaml' 2026-02-14T10:26:51,192 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_global_facts.yaml' 2026-02-14T10:26:51,193 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_biology.yaml' 2026-02-14T10:26:51,194 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_chemistry.yaml' 2026-02-14T10:26:51,195 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_computer_science.yaml' 2026-02-14T10:26:51,197 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_european_history.yaml' 2026-02-14T10:26:51,198 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_geography.yaml' 2026-02-14T10:26:51,199 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_government_and_politics.yaml' 2026-02-14T10:26:51,200 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_macroeconomics.yaml' 2026-02-14T10:26:51,201 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_mathematics.yaml' 2026-02-14T10:26:51,202 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_microeconomics.yaml' 2026-02-14T10:26:51,204 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_physics.yaml' 2026-02-14T10:26:51,205 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_psychology.yaml' 2026-02-14T10:26:51,206 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_statistics.yaml' 2026-02-14T10:26:51,207 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_us_history.yaml' 2026-02-14T10:26:51,208 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_world_history.yaml' 2026-02-14T10:26:51,210 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_aging.yaml' 2026-02-14T10:26:51,211 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_sexuality.yaml' 2026-02-14T10:26:51,212 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_international_law.yaml' 2026-02-14T10:26:51,213 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_jurisprudence.yaml' 2026-02-14T10:26:51,214 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_logical_fallacies.yaml' 2026-02-14T10:26:51,216 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_machine_learning.yaml' 2026-02-14T10:26:51,217 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_management.yaml' 2026-02-14T10:26:51,218 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_marketing.yaml' 2026-02-14T10:26:51,219 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_medical_genetics.yaml' 2026-02-14T10:26:51,220 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_miscellaneous.yaml' 2026-02-14T10:26:51,222 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_disputes.yaml' 2026-02-14T10:26:51,223 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_scenarios.yaml' 2026-02-14T10:26:51,224 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_nutrition.yaml' 2026-02-14T10:26:51,225 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_philosophy.yaml' 2026-02-14T10:26:51,226 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_prehistory.yaml' 2026-02-14T10:26:51,227 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_accounting.yaml' 2026-02-14T10:26:51,228 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_law.yaml' 2026-02-14T10:26:51,230 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_medicine.yaml' 2026-02-14T10:26:51,231 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_psychology.yaml' 2026-02-14T10:26:51,232 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_public_relations.yaml' 2026-02-14T10:26:51,233 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_security_studies.yaml' 2026-02-14T10:26:51,234 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_sociology.yaml' 2026-02-14T10:26:51,235 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_us_foreign_policy.yaml' 2026-02-14T10:26:51,236 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_virology.yaml' 2026-02-14T10:26:51,238 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_world_religions.yaml' 2026-02-14T10:26:51,239 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_abstract_algebra.yaml' 2026-02-14T10:26:51,240 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_anatomy.yaml' 2026-02-14T10:26:51,241 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_astronomy.yaml' 2026-02-14T10:26:51,242 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_business_ethics.yaml' 2026-02-14T10:26:51,243 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_clinical_knowledge.yaml' 2026-02-14T10:26:51,244 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_biology.yaml' 2026-02-14T10:26:51,246 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_chemistry.yaml' 2026-02-14T10:26:51,247 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_computer_science.yaml' 2026-02-14T10:26:51,248 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_mathematics.yaml' 2026-02-14T10:26:51,249 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_medicine.yaml' 2026-02-14T10:26:51,251 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_physics.yaml' 2026-02-14T10:26:51,252 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_computer_security.yaml' 2026-02-14T10:26:51,253 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_conceptual_physics.yaml' 2026-02-14T10:26:51,254 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_econometrics.yaml' 2026-02-14T10:26:51,255 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_electrical_engineering.yaml' 2026-02-14T10:26:51,257 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_elementary_mathematics.yaml' 2026-02-14T10:26:51,258 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_formal_logic.yaml' 2026-02-14T10:26:51,259 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_global_facts.yaml' 2026-02-14T10:26:51,260 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_biology.yaml' 2026-02-14T10:26:51,261 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_chemistry.yaml' 2026-02-14T10:26:51,262 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_computer_science.yaml' 2026-02-14T10:26:51,264 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_european_history.yaml' 2026-02-14T10:26:51,265 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_geography.yaml' 2026-02-14T10:26:51,266 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_government_and_politics.yaml' 2026-02-14T10:26:51,267 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_macroeconomics.yaml' 2026-02-14T10:26:51,269 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_mathematics.yaml' 2026-02-14T10:26:51,270 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_microeconomics.yaml' 2026-02-14T10:26:51,271 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_physics.yaml' 2026-02-14T10:26:51,272 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_psychology.yaml' 2026-02-14T10:26:51,273 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_statistics.yaml' 2026-02-14T10:26:51,274 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_us_history.yaml' 2026-02-14T10:26:51,275 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_world_history.yaml' 2026-02-14T10:26:51,276 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_aging.yaml' 2026-02-14T10:26:51,277 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_sexuality.yaml' 2026-02-14T10:26:51,278 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_international_law.yaml' 2026-02-14T10:26:51,280 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_jurisprudence.yaml' 2026-02-14T10:26:51,281 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_logical_fallacies.yaml' 2026-02-14T10:26:51,282 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_machine_learning.yaml' 2026-02-14T10:26:51,283 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_management.yaml' 2026-02-14T10:26:51,284 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_marketing.yaml' 2026-02-14T10:26:51,285 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_medical_genetics.yaml' 2026-02-14T10:26:51,286 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_miscellaneous.yaml' 2026-02-14T10:26:51,288 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_disputes.yaml' 2026-02-14T10:26:51,289 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_scenarios.yaml' 2026-02-14T10:26:51,290 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_nutrition.yaml' 2026-02-14T10:26:51,291 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_philosophy.yaml' 2026-02-14T10:26:51,292 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_prehistory.yaml' 2026-02-14T10:26:51,293 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_accounting.yaml' 2026-02-14T10:26:51,294 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_law.yaml' 2026-02-14T10:26:51,296 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_medicine.yaml' 2026-02-14T10:26:51,297 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_psychology.yaml' 2026-02-14T10:26:51,298 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_public_relations.yaml' 2026-02-14T10:26:51,299 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_security_studies.yaml' 2026-02-14T10:26:51,300 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_sociology.yaml' 2026-02-14T10:26:51,302 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_us_foreign_policy.yaml' 2026-02-14T10:26:51,303 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_virology.yaml' 2026-02-14T10:26:51,304 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_world_religions.yaml' 2026-02-14T10:26:51,305 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_abstract_algebra.yaml' 2026-02-14T10:26:51,307 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_anatomy.yaml' 2026-02-14T10:26:51,308 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_astronomy.yaml' 2026-02-14T10:26:51,309 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_business_ethics.yaml' 2026-02-14T10:26:51,310 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_clinical_knowledge.yaml' 2026-02-14T10:26:51,311 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_biology.yaml' 2026-02-14T10:26:51,313 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_chemistry.yaml' 2026-02-14T10:26:51,314 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_computer_science.yaml' 2026-02-14T10:26:51,315 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_mathematics.yaml' 2026-02-14T10:26:51,316 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_medicine.yaml' 2026-02-14T10:26:51,317 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_physics.yaml' 2026-02-14T10:26:51,318 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_computer_security.yaml' 2026-02-14T10:26:51,319 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_conceptual_physics.yaml' 2026-02-14T10:26:51,320 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_econometrics.yaml' 2026-02-14T10:26:51,322 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_electrical_engineering.yaml' 2026-02-14T10:26:51,323 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_elementary_mathematics.yaml' 2026-02-14T10:26:51,324 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_formal_logic.yaml' 2026-02-14T10:26:51,325 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_global_facts.yaml' 2026-02-14T10:26:51,326 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_biology.yaml' 2026-02-14T10:26:51,327 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_chemistry.yaml' 2026-02-14T10:26:51,328 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_computer_science.yaml' 2026-02-14T10:26:51,330 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_european_history.yaml' 2026-02-14T10:26:51,331 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_geography.yaml' 2026-02-14T10:26:51,332 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_government_and_politics.yaml' 2026-02-14T10:26:51,333 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_macroeconomics.yaml' 2026-02-14T10:26:51,334 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_mathematics.yaml' 2026-02-14T10:26:51,335 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_microeconomics.yaml' 2026-02-14T10:26:51,337 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_physics.yaml' 2026-02-14T10:26:51,338 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_psychology.yaml' 2026-02-14T10:26:51,339 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_statistics.yaml' 2026-02-14T10:26:51,340 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_us_history.yaml' 2026-02-14T10:26:51,341 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_world_history.yaml' 2026-02-14T10:26:51,342 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_aging.yaml' 2026-02-14T10:26:51,344 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_sexuality.yaml' 2026-02-14T10:26:51,345 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_international_law.yaml' 2026-02-14T10:26:51,346 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_jurisprudence.yaml' 2026-02-14T10:26:51,347 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_logical_fallacies.yaml' 2026-02-14T10:26:51,348 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_machine_learning.yaml' 2026-02-14T10:26:51,349 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_management.yaml' 2026-02-14T10:26:51,351 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_marketing.yaml' 2026-02-14T10:26:51,352 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_medical_genetics.yaml' 2026-02-14T10:26:51,353 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_miscellaneous.yaml' 2026-02-14T10:26:51,354 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_disputes.yaml' 2026-02-14T10:26:51,355 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_scenarios.yaml' 2026-02-14T10:26:51,357 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_nutrition.yaml' 2026-02-14T10:26:51,358 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_philosophy.yaml' 2026-02-14T10:26:51,359 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_prehistory.yaml' 2026-02-14T10:26:51,360 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_accounting.yaml' 2026-02-14T10:26:51,361 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_law.yaml' 2026-02-14T10:26:51,362 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_medicine.yaml' 2026-02-14T10:26:51,364 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_psychology.yaml' 2026-02-14T10:26:51,365 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_public_relations.yaml' 2026-02-14T10:26:51,366 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_security_studies.yaml' 2026-02-14T10:26:51,367 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_sociology.yaml' 2026-02-14T10:26:51,368 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_us_foreign_policy.yaml' 2026-02-14T10:26:51,369 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_virology.yaml' 2026-02-14T10:26:51,370 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_world_religions.yaml' 2026-02-14T10:26:51,371 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_abstract_algebra.yaml' 2026-02-14T10:26:51,372 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_anatomy.yaml' 2026-02-14T10:26:51,373 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_astronomy.yaml' 2026-02-14T10:26:51,375 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_business_ethics.yaml' 2026-02-14T10:26:51,376 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_clinical_knowledge.yaml' 2026-02-14T10:26:51,377 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_biology.yaml' 2026-02-14T10:26:51,378 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_chemistry.yaml' 2026-02-14T10:26:51,379 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_computer_science.yaml' 2026-02-14T10:26:51,380 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_mathematics.yaml' 2026-02-14T10:26:51,381 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_medicine.yaml' 2026-02-14T10:26:51,383 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_physics.yaml' 2026-02-14T10:26:51,384 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_computer_security.yaml' 2026-02-14T10:26:51,385 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_conceptual_physics.yaml' 2026-02-14T10:26:51,386 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_econometrics.yaml' 2026-02-14T10:26:51,387 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_electrical_engineering.yaml' 2026-02-14T10:26:51,389 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_elementary_mathematics.yaml' 2026-02-14T10:26:51,390 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_formal_logic.yaml' 2026-02-14T10:26:51,391 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_global_facts.yaml' 2026-02-14T10:26:51,392 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_biology.yaml' 2026-02-14T10:26:51,394 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_chemistry.yaml' 2026-02-14T10:26:51,395 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_computer_science.yaml' 2026-02-14T10:26:51,396 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_european_history.yaml' 2026-02-14T10:26:51,397 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_geography.yaml' 2026-02-14T10:26:51,398 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_government_and_politics.yaml' 2026-02-14T10:26:51,399 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_macroeconomics.yaml' 2026-02-14T10:26:51,401 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_mathematics.yaml' 2026-02-14T10:26:51,402 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_microeconomics.yaml' 2026-02-14T10:26:51,403 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_physics.yaml' 2026-02-14T10:26:51,404 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_psychology.yaml' 2026-02-14T10:26:51,405 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_statistics.yaml' 2026-02-14T10:26:51,407 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_us_history.yaml' 2026-02-14T10:26:51,408 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_world_history.yaml' 2026-02-14T10:26:51,409 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_aging.yaml' 2026-02-14T10:26:51,410 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_sexuality.yaml' 2026-02-14T10:26:51,411 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_international_law.yaml' 2026-02-14T10:26:51,412 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_jurisprudence.yaml' 2026-02-14T10:26:51,413 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_logical_fallacies.yaml' 2026-02-14T10:26:51,414 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_machine_learning.yaml' 2026-02-14T10:26:51,415 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_management.yaml' 2026-02-14T10:26:51,417 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_marketing.yaml' 2026-02-14T10:26:51,418 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_medical_genetics.yaml' 2026-02-14T10:26:51,419 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_miscellaneous.yaml' 2026-02-14T10:26:51,420 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_disputes.yaml' 2026-02-14T10:26:51,421 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_scenarios.yaml' 2026-02-14T10:26:51,422 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_nutrition.yaml' 2026-02-14T10:26:51,423 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_philosophy.yaml' 2026-02-14T10:26:51,424 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_prehistory.yaml' 2026-02-14T10:26:51,426 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_accounting.yaml' 2026-02-14T10:26:51,427 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_law.yaml' 2026-02-14T10:26:51,428 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_medicine.yaml' 2026-02-14T10:26:51,429 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_psychology.yaml' 2026-02-14T10:26:51,430 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_public_relations.yaml' 2026-02-14T10:26:51,432 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_security_studies.yaml' 2026-02-14T10:26:51,433 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_sociology.yaml' 2026-02-14T10:26:51,434 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_us_foreign_policy.yaml' 2026-02-14T10:26:51,435 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_virology.yaml' 2026-02-14T10:26:51,436 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_world_religions.yaml' 2026-02-14T10:26:51,438 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_abstract_algebra.yaml' 2026-02-14T10:26:51,439 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_anatomy.yaml' 2026-02-14T10:26:51,440 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_astronomy.yaml' 2026-02-14T10:26:51,441 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_business_ethics.yaml' 2026-02-14T10:26:51,442 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_clinical_knowledge.yaml' 2026-02-14T10:26:51,443 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_biology.yaml' 2026-02-14T10:26:51,445 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_chemistry.yaml' 2026-02-14T10:26:51,446 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_computer_science.yaml' 2026-02-14T10:26:51,447 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_mathematics.yaml' 2026-02-14T10:26:51,448 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_medicine.yaml' 2026-02-14T10:26:51,449 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_physics.yaml' 2026-02-14T10:26:51,451 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_computer_security.yaml' 2026-02-14T10:26:51,452 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_conceptual_physics.yaml' 2026-02-14T10:26:51,453 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_econometrics.yaml' 2026-02-14T10:26:51,454 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_electrical_engineering.yaml' 2026-02-14T10:26:51,455 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_elementary_mathematics.yaml' 2026-02-14T10:26:51,456 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_formal_logic.yaml' 2026-02-14T10:26:51,457 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_global_facts.yaml' 2026-02-14T10:26:51,458 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_biology.yaml' 2026-02-14T10:26:51,459 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_chemistry.yaml' 2026-02-14T10:26:51,460 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_computer_science.yaml' 2026-02-14T10:26:51,461 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_european_history.yaml' 2026-02-14T10:26:51,463 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_geography.yaml' 2026-02-14T10:26:51,464 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_government_and_politics.yaml' 2026-02-14T10:26:51,465 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_macroeconomics.yaml' 2026-02-14T10:26:51,466 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_mathematics.yaml' 2026-02-14T10:26:51,467 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_microeconomics.yaml' 2026-02-14T10:26:51,468 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_physics.yaml' 2026-02-14T10:26:51,469 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_psychology.yaml' 2026-02-14T10:26:51,470 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_statistics.yaml' 2026-02-14T10:26:51,472 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_us_history.yaml' 2026-02-14T10:26:51,473 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_world_history.yaml' 2026-02-14T10:26:51,474 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_aging.yaml' 2026-02-14T10:26:51,475 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_sexuality.yaml' 2026-02-14T10:26:51,477 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_international_law.yaml' 2026-02-14T10:26:51,478 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_jurisprudence.yaml' 2026-02-14T10:26:51,479 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_logical_fallacies.yaml' 2026-02-14T10:26:51,480 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_machine_learning.yaml' 2026-02-14T10:26:51,481 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_management.yaml' 2026-02-14T10:26:51,482 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_marketing.yaml' 2026-02-14T10:26:51,484 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_medical_genetics.yaml' 2026-02-14T10:26:51,485 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_miscellaneous.yaml' 2026-02-14T10:26:51,486 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_disputes.yaml' 2026-02-14T10:26:51,487 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_scenarios.yaml' 2026-02-14T10:26:51,488 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_nutrition.yaml' 2026-02-14T10:26:51,489 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_philosophy.yaml' 2026-02-14T10:26:51,491 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_prehistory.yaml' 2026-02-14T10:26:51,492 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_accounting.yaml' 2026-02-14T10:26:51,493 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_law.yaml' 2026-02-14T10:26:51,494 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_medicine.yaml' 2026-02-14T10:26:51,495 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_psychology.yaml' 2026-02-14T10:26:51,497 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_public_relations.yaml' 2026-02-14T10:26:51,498 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_security_studies.yaml' 2026-02-14T10:26:51,499 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_sociology.yaml' 2026-02-14T10:26:51,500 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_us_foreign_policy.yaml' 2026-02-14T10:26:51,501 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_virology.yaml' 2026-02-14T10:26:51,502 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_world_religions.yaml' 2026-02-14T10:26:51,503 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_abstract_algebra.yaml' 2026-02-14T10:26:51,504 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_anatomy.yaml' 2026-02-14T10:26:51,505 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_astronomy.yaml' 2026-02-14T10:26:51,506 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_business_ethics.yaml' 2026-02-14T10:26:51,508 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_clinical_knowledge.yaml' 2026-02-14T10:26:51,509 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_biology.yaml' 2026-02-14T10:26:51,510 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_chemistry.yaml' 2026-02-14T10:26:51,511 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_computer_science.yaml' 2026-02-14T10:26:51,512 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_mathematics.yaml' 2026-02-14T10:26:51,513 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_medicine.yaml' 2026-02-14T10:26:51,514 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_physics.yaml' 2026-02-14T10:26:51,516 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_computer_security.yaml' 2026-02-14T10:26:51,517 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_conceptual_physics.yaml' 2026-02-14T10:26:51,518 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_econometrics.yaml' 2026-02-14T10:26:51,519 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_electrical_engineering.yaml' 2026-02-14T10:26:51,520 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_elementary_mathematics.yaml' 2026-02-14T10:26:51,522 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_formal_logic.yaml' 2026-02-14T10:26:51,523 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_global_facts.yaml' 2026-02-14T10:26:51,524 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_biology.yaml' 2026-02-14T10:26:51,525 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_chemistry.yaml' 2026-02-14T10:26:51,526 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_computer_science.yaml' 2026-02-14T10:26:51,527 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_european_history.yaml' 2026-02-14T10:26:51,529 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_geography.yaml' 2026-02-14T10:26:51,530 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_government_and_politics.yaml' 2026-02-14T10:26:51,531 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_macroeconomics.yaml' 2026-02-14T10:26:51,532 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_mathematics.yaml' 2026-02-14T10:26:51,533 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_microeconomics.yaml' 2026-02-14T10:26:51,535 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_physics.yaml' 2026-02-14T10:26:51,536 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_psychology.yaml' 2026-02-14T10:26:51,537 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_statistics.yaml' 2026-02-14T10:26:51,538 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_us_history.yaml' 2026-02-14T10:26:51,539 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_world_history.yaml' 2026-02-14T10:26:51,541 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_aging.yaml' 2026-02-14T10:26:51,542 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_sexuality.yaml' 2026-02-14T10:26:51,543 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_international_law.yaml' 2026-02-14T10:26:51,544 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_jurisprudence.yaml' 2026-02-14T10:26:51,545 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_logical_fallacies.yaml' 2026-02-14T10:26:51,546 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_machine_learning.yaml' 2026-02-14T10:26:51,547 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_management.yaml' 2026-02-14T10:26:51,548 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_marketing.yaml' 2026-02-14T10:26:51,549 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_medical_genetics.yaml' 2026-02-14T10:26:51,550 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_miscellaneous.yaml' 2026-02-14T10:26:51,552 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_disputes.yaml' 2026-02-14T10:26:51,553 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_scenarios.yaml' 2026-02-14T10:26:51,554 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_nutrition.yaml' 2026-02-14T10:26:51,555 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_philosophy.yaml' 2026-02-14T10:26:51,556 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_prehistory.yaml' 2026-02-14T10:26:51,557 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_accounting.yaml' 2026-02-14T10:26:51,558 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_law.yaml' 2026-02-14T10:26:51,559 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_medicine.yaml' 2026-02-14T10:26:51,561 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_psychology.yaml' 2026-02-14T10:26:51,562 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_public_relations.yaml' 2026-02-14T10:26:51,563 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_security_studies.yaml' 2026-02-14T10:26:51,564 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_sociology.yaml' 2026-02-14T10:26:51,566 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_us_foreign_policy.yaml' 2026-02-14T10:26:51,567 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_virology.yaml' 2026-02-14T10:26:51,568 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_world_religions.yaml' 2026-02-14T10:26:51,569 adding 'lm_eval/tasks/openai-mmmlu/default/utils.py' 2026-02-14T10:26:51,571 adding 'lm_eval/tasks/openbookqa/README.md' 2026-02-14T10:26:51,572 adding 'lm_eval/tasks/openbookqa/openbookqa.yaml' 2026-02-14T10:26:51,574 adding 'lm_eval/tasks/paloma/README.md' 2026-02-14T10:26:51,576 adding 'lm_eval/tasks/paloma/_paloma_template' 2026-02-14T10:26:51,577 adding 'lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml' 2026-02-14T10:26:51,578 adding 'lm_eval/tasks/paloma/paloma_c4_100_domains.yaml' 2026-02-14T10:26:51,579 adding 'lm_eval/tasks/paloma/paloma_c4_en.yaml' 2026-02-14T10:26:51,580 adding 'lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml' 2026-02-14T10:26:51,581 adding 'lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml' 2026-02-14T10:26:51,582 adding 'lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml' 2026-02-14T10:26:51,584 adding 'lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml' 2026-02-14T10:26:51,585 adding 'lm_eval/tasks/paloma/paloma_gab.yaml' 2026-02-14T10:26:51,586 adding 'lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml' 2026-02-14T10:26:51,587 adding 'lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml' 2026-02-14T10:26:51,588 adding 'lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml' 2026-02-14T10:26:51,589 adding 'lm_eval/tasks/paloma/paloma_mc4.yaml' 2026-02-14T10:26:51,590 adding 'lm_eval/tasks/paloma/paloma_ptb.yaml' 2026-02-14T10:26:51,592 adding 'lm_eval/tasks/paloma/paloma_redpajama.yaml' 2026-02-14T10:26:51,593 adding 'lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml' 2026-02-14T10:26:51,594 adding 'lm_eval/tasks/paloma/paloma_utils.py' 2026-02-14T10:26:51,595 adding 'lm_eval/tasks/paloma/paloma_wikitext_103.yaml' 2026-02-14T10:26:51,597 adding 'lm_eval/tasks/paws-x/README.md' 2026-02-14T10:26:51,598 adding 'lm_eval/tasks/paws-x/_generate_config.py' 2026-02-14T10:26:51,599 adding 'lm_eval/tasks/paws-x/_pawsx.yaml' 2026-02-14T10:26:51,600 adding 'lm_eval/tasks/paws-x/paws_de.yaml' 2026-02-14T10:26:51,601 adding 'lm_eval/tasks/paws-x/paws_en.yaml' 2026-02-14T10:26:51,602 adding 'lm_eval/tasks/paws-x/paws_es.yaml' 2026-02-14T10:26:51,604 adding 'lm_eval/tasks/paws-x/paws_fr.yaml' 2026-02-14T10:26:51,605 adding 'lm_eval/tasks/paws-x/paws_ja.yaml' 2026-02-14T10:26:51,606 adding 'lm_eval/tasks/paws-x/paws_ko.yaml' 2026-02-14T10:26:51,607 adding 'lm_eval/tasks/paws-x/paws_zh.yaml' 2026-02-14T10:26:51,608 adding 'lm_eval/tasks/paws-x/pawsx_template_yaml' 2026-02-14T10:26:51,609 adding 'lm_eval/tasks/paws-x/utils.py' 2026-02-14T10:26:51,611 adding 'lm_eval/tasks/pile/README.md' 2026-02-14T10:26:51,612 adding 'lm_eval/tasks/pile/pile_arxiv.yaml' 2026-02-14T10:26:51,614 adding 'lm_eval/tasks/pile/pile_bookcorpus2.yaml' 2026-02-14T10:26:51,615 adding 'lm_eval/tasks/pile/pile_books3.yaml' 2026-02-14T10:26:51,616 adding 'lm_eval/tasks/pile/pile_dm-mathematics.yaml' 2026-02-14T10:26:51,617 adding 'lm_eval/tasks/pile/pile_enron.yaml' 2026-02-14T10:26:51,618 adding 'lm_eval/tasks/pile/pile_europarl.yaml' 2026-02-14T10:26:51,619 adding 'lm_eval/tasks/pile/pile_freelaw.yaml' 2026-02-14T10:26:51,620 adding 'lm_eval/tasks/pile/pile_github.yaml' 2026-02-14T10:26:51,621 adding 'lm_eval/tasks/pile/pile_gutenberg.yaml' 2026-02-14T10:26:51,622 adding 'lm_eval/tasks/pile/pile_hackernews.yaml' 2026-02-14T10:26:51,623 adding 'lm_eval/tasks/pile/pile_nih-exporter.yaml' 2026-02-14T10:26:51,624 adding 'lm_eval/tasks/pile/pile_opensubtitles.yaml' 2026-02-14T10:26:51,625 adding 'lm_eval/tasks/pile/pile_openwebtext2.yaml' 2026-02-14T10:26:51,626 adding 'lm_eval/tasks/pile/pile_philpapers.yaml' 2026-02-14T10:26:51,628 adding 'lm_eval/tasks/pile/pile_pile-cc.yaml' 2026-02-14T10:26:51,629 adding 'lm_eval/tasks/pile/pile_pubmed-abstracts.yaml' 2026-02-14T10:26:51,630 adding 'lm_eval/tasks/pile/pile_pubmed-central.yaml' 2026-02-14T10:26:51,631 adding 'lm_eval/tasks/pile/pile_stackexchange.yaml' 2026-02-14T10:26:51,632 adding 'lm_eval/tasks/pile/pile_ubuntu-irc.yaml' 2026-02-14T10:26:51,633 adding 'lm_eval/tasks/pile/pile_uspto.yaml' 2026-02-14T10:26:51,634 adding 'lm_eval/tasks/pile/pile_wikipedia.yaml' 2026-02-14T10:26:51,635 adding 'lm_eval/tasks/pile/pile_youtubesubtitles.yaml' 2026-02-14T10:26:51,637 adding 'lm_eval/tasks/pile_10k/README.md' 2026-02-14T10:26:51,638 adding 'lm_eval/tasks/pile_10k/pile_10k.yaml' 2026-02-14T10:26:51,640 adding 'lm_eval/tasks/piqa/README.md' 2026-02-14T10:26:51,641 adding 'lm_eval/tasks/piqa/piqa.yaml' 2026-02-14T10:26:51,643 adding 'lm_eval/tasks/pisa/README.md' 2026-02-14T10:26:51,644 adding 'lm_eval/tasks/pisa/_pisa.yaml' 2026-02-14T10:26:51,646 adding 'lm_eval/tasks/pisa/_pisa_llm_judged.yaml' 2026-02-14T10:26:51,647 adding 'lm_eval/tasks/pisa/_template_yaml' 2026-02-14T10:26:51,648 adding 'lm_eval/tasks/pisa/pisa_ch.yaml' 2026-02-14T10:26:51,649 adding 'lm_eval/tasks/pisa/pisa_ch_llm_judged.yaml' 2026-02-14T10:26:51,650 adding 'lm_eval/tasks/pisa/pisa_de.yaml' 2026-02-14T10:26:51,652 adding 'lm_eval/tasks/pisa/pisa_de_llm_judged.yaml' 2026-02-14T10:26:51,653 adding 'lm_eval/tasks/pisa/pisa_en.yaml' 2026-02-14T10:26:51,654 adding 'lm_eval/tasks/pisa/pisa_en_llm_judged.yaml' 2026-02-14T10:26:51,655 adding 'lm_eval/tasks/pisa/pisa_es.yaml' 2026-02-14T10:26:51,656 adding 'lm_eval/tasks/pisa/pisa_es_llm_judged.yaml' 2026-02-14T10:26:51,657 adding 'lm_eval/tasks/pisa/pisa_fr.yaml' 2026-02-14T10:26:51,659 adding 'lm_eval/tasks/pisa/pisa_fr_llm_judged.yaml' 2026-02-14T10:26:51,660 adding 'lm_eval/tasks/pisa/pisa_it.yaml' 2026-02-14T10:26:51,661 adding 'lm_eval/tasks/pisa/pisa_it_llm_judged.yaml' 2026-02-14T10:26:51,663 adding 'lm_eval/tasks/pisa/utils.py' 2026-02-14T10:26:51,665 adding 'lm_eval/tasks/polemo2/README.md' 2026-02-14T10:26:51,666 adding 'lm_eval/tasks/polemo2/polemo2_in.yaml' 2026-02-14T10:26:51,667 adding 'lm_eval/tasks/polemo2/polemo2_out.yaml' 2026-02-14T10:26:51,669 adding 'lm_eval/tasks/portuguese_bench/README.md' 2026-02-14T10:26:51,670 adding 'lm_eval/tasks/portuguese_bench/assin_entailment.yaml' 2026-02-14T10:26:51,671 adding 'lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml' 2026-02-14T10:26:51,672 adding 'lm_eval/tasks/portuguese_bench/portuguese_bench.yaml' 2026-02-14T10:26:51,674 adding 'lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml' 2026-02-14T10:26:51,676 adding 'lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py' 2026-02-14T10:26:51,677 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml' 2026-02-14T10:26:51,678 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml' 2026-02-14T10:26:51,680 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml' 2026-02-14T10:26:51,681 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml' 2026-02-14T10:26:51,682 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml' 2026-02-14T10:26:51,683 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml' 2026-02-14T10:26:51,684 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml' 2026-02-14T10:26:51,685 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml' 2026-02-14T10:26:51,686 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml' 2026-02-14T10:26:51,687 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml' 2026-02-14T10:26:51,688 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml' 2026-02-14T10:26:51,690 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml' 2026-02-14T10:26:51,691 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml' 2026-02-14T10:26:51,692 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml' 2026-02-14T10:26:51,693 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml' 2026-02-14T10:26:51,694 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml' 2026-02-14T10:26:51,695 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml' 2026-02-14T10:26:51,697 adding 'lm_eval/tasks/prost/README.md' 2026-02-14T10:26:51,698 adding 'lm_eval/tasks/prost/corypaik_prost.yaml' 2026-02-14T10:26:51,700 adding 'lm_eval/tasks/pubmedqa/README.md' 2026-02-14T10:26:51,702 adding 'lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py' 2026-02-14T10:26:51,703 adding 'lm_eval/tasks/pubmedqa/pubmedqa.yaml' 2026-02-14T10:26:51,705 adding 'lm_eval/tasks/qa4mre/README.md' 2026-02-14T10:26:51,706 adding 'lm_eval/tasks/qa4mre/preprocess_qa4mre.py' 2026-02-14T10:26:51,707 adding 'lm_eval/tasks/qa4mre/qa4mre_2011.yaml' 2026-02-14T10:26:51,708 adding 'lm_eval/tasks/qa4mre/qa4mre_2012.yaml' 2026-02-14T10:26:51,709 adding 'lm_eval/tasks/qa4mre/qa4mre_2013.yaml' 2026-02-14T10:26:51,712 adding 'lm_eval/tasks/qasper/README.md' 2026-02-14T10:26:51,713 adding 'lm_eval/tasks/qasper/bool.yaml' 2026-02-14T10:26:51,714 adding 'lm_eval/tasks/qasper/freeform.yaml' 2026-02-14T10:26:51,715 adding 'lm_eval/tasks/qasper/metrics.py' 2026-02-14T10:26:51,717 adding 'lm_eval/tasks/qasper/utils.py' 2026-02-14T10:26:51,719 adding 'lm_eval/tasks/race/README.md' 2026-02-14T10:26:51,720 adding 'lm_eval/tasks/race/preprocess_race.py' 2026-02-14T10:26:51,721 adding 'lm_eval/tasks/race/race.yaml' 2026-02-14T10:26:51,723 adding 'lm_eval/tasks/realtoxicityprompts/metric.py' 2026-02-14T10:26:51,724 adding 'lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml' 2026-02-14T10:26:51,727 adding 'lm_eval/tasks/ruler/README.md' 2026-02-14T10:26:51,728 adding 'lm_eval/tasks/ruler/common_utils.py' 2026-02-14T10:26:51,729 adding 'lm_eval/tasks/ruler/cwe.yaml' 2026-02-14T10:26:51,731 adding 'lm_eval/tasks/ruler/cwe_utils.py' 2026-02-14T10:26:51,732 adding 'lm_eval/tasks/ruler/essays.py' 2026-02-14T10:26:51,733 adding 'lm_eval/tasks/ruler/fwe.yaml' 2026-02-14T10:26:51,734 adding 'lm_eval/tasks/ruler/fwe_utils.py' 2026-02-14T10:26:51,736 adding 'lm_eval/tasks/ruler/niah_multikey_1.yaml' 2026-02-14T10:26:51,737 adding 'lm_eval/tasks/ruler/niah_multikey_2.yaml' 2026-02-14T10:26:51,738 adding 'lm_eval/tasks/ruler/niah_multikey_3.yaml' 2026-02-14T10:26:51,739 adding 'lm_eval/tasks/ruler/niah_multiquery.yaml' 2026-02-14T10:26:51,740 adding 'lm_eval/tasks/ruler/niah_multivalue.yaml' 2026-02-14T10:26:51,741 adding 'lm_eval/tasks/ruler/niah_single_1.yaml' 2026-02-14T10:26:51,742 adding 'lm_eval/tasks/ruler/niah_single_2.yaml' 2026-02-14T10:26:51,743 adding 'lm_eval/tasks/ruler/niah_single_3.yaml' 2026-02-14T10:26:51,744 adding 'lm_eval/tasks/ruler/niah_utils.py' 2026-02-14T10:26:51,746 adding 'lm_eval/tasks/ruler/prepare_niah.py' 2026-02-14T10:26:51,748 adding 'lm_eval/tasks/ruler/qa_hotpot.yaml' 2026-02-14T10:26:51,749 adding 'lm_eval/tasks/ruler/qa_squad.yaml' 2026-02-14T10:26:51,751 adding 'lm_eval/tasks/ruler/qa_utils.py' 2026-02-14T10:26:51,752 adding 'lm_eval/tasks/ruler/ruler.yaml' 2026-02-14T10:26:51,753 adding 'lm_eval/tasks/ruler/vt.yaml' 2026-02-14T10:26:51,755 adding 'lm_eval/tasks/ruler/vt_utils.py' 2026-02-14T10:26:51,757 adding 'lm_eval/tasks/sciq/README.md' 2026-02-14T10:26:51,758 adding 'lm_eval/tasks/sciq/sciq.yaml' 2026-02-14T10:26:51,760 adding 'lm_eval/tasks/score/NON_GREEDY.md' 2026-02-14T10:26:51,762 adding 'lm_eval/tasks/score/README.md' 2026-02-14T10:26:51,763 adding 'lm_eval/tasks/score/non_greedy.sh' 2026-02-14T10:26:51,765 adding 'lm_eval/tasks/score/non_greedy_summarizer.py' 2026-02-14T10:26:51,766 adding 'lm_eval/tasks/score/score_robustness.yaml' 2026-02-14T10:26:51,768 adding 'lm_eval/tasks/score/utils.py' 2026-02-14T10:26:51,770 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml' 2026-02-14T10:26:51,772 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml' 2026-02-14T10:26:51,773 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml' 2026-02-14T10:26:51,774 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml' 2026-02-14T10:26:51,776 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml' 2026-02-14T10:26:51,777 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml' 2026-02-14T10:26:51,778 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml' 2026-02-14T10:26:51,779 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml' 2026-02-14T10:26:51,781 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml' 2026-02-14T10:26:51,782 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml' 2026-02-14T10:26:51,783 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml' 2026-02-14T10:26:51,785 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml' 2026-02-14T10:26:51,786 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml' 2026-02-14T10:26:51,787 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml' 2026-02-14T10:26:51,788 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml' 2026-02-14T10:26:51,790 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml' 2026-02-14T10:26:51,791 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml' 2026-02-14T10:26:51,793 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml' 2026-02-14T10:26:51,794 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml' 2026-02-14T10:26:51,795 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml' 2026-02-14T10:26:51,797 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml' 2026-02-14T10:26:51,798 adding 'lm_eval/tasks/score/agi_eval/prompt_templates.json' 2026-02-14T10:26:51,800 adding 'lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml' 2026-02-14T10:26:51,801 adding 'lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml' 2026-02-14T10:26:51,802 adding 'lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml' 2026-02-14T10:26:51,804 adding 'lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml' 2026-02-14T10:26:51,805 adding 'lm_eval/tasks/score/agi_eval/utils_agieval.py' 2026-02-14T10:26:51,809 adding 'lm_eval/tasks/score/math/math_grader.py' 2026-02-14T10:26:51,810 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml' 2026-02-14T10:26:51,811 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml' 2026-02-14T10:26:51,812 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml' 2026-02-14T10:26:51,814 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml' 2026-02-14T10:26:51,815 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml' 2026-02-14T10:26:51,816 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml' 2026-02-14T10:26:51,817 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml' 2026-02-14T10:26:51,818 adding 'lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml' 2026-02-14T10:26:51,820 adding 'lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml' 2026-02-14T10:26:51,821 adding 'lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml' 2026-02-14T10:26:51,822 adding 'lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml' 2026-02-14T10:26:51,824 adding 'lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml' 2026-02-14T10:26:51,825 adding 'lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml' 2026-02-14T10:26:51,826 adding 'lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml' 2026-02-14T10:26:51,828 adding 'lm_eval/tasks/score/math/prompt_templates.json' 2026-02-14T10:26:51,829 adding 'lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml' 2026-02-14T10:26:51,830 adding 'lm_eval/tasks/score/math/score_prompt_robustness_math.yaml' 2026-02-14T10:26:51,831 adding 'lm_eval/tasks/score/math/score_robustness_math.yaml' 2026-02-14T10:26:51,833 adding 'lm_eval/tasks/score/math/to_be_fixed_questions.json' 2026-02-14T10:26:51,834 adding 'lm_eval/tasks/score/math/utils_math.py' 2026-02-14T10:26:51,837 adding 'lm_eval/tasks/score/mmlu_pro/prompt_templates.json' 2026-02-14T10:26:51,838 adding 'lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml' 2026-02-14T10:26:51,839 adding 'lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml' 2026-02-14T10:26:51,841 adding 'lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml' 2026-02-14T10:26:51,842 adding 'lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py' 2026-02-14T10:26:51,845 adding 'lm_eval/tasks/scrolls/README.md' 2026-02-14T10:26:51,846 adding 'lm_eval/tasks/scrolls/scrolls_contractnli.yaml' 2026-02-14T10:26:51,847 adding 'lm_eval/tasks/scrolls/scrolls_govreport.yaml' 2026-02-14T10:26:51,848 adding 'lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml' 2026-02-14T10:26:51,849 adding 'lm_eval/tasks/scrolls/scrolls_qasper.yaml' 2026-02-14T10:26:51,850 adding 'lm_eval/tasks/scrolls/scrolls_qmsum.yaml' 2026-02-14T10:26:51,851 adding 'lm_eval/tasks/scrolls/scrolls_quality.yaml' 2026-02-14T10:26:51,853 adding 'lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml' 2026-02-14T10:26:51,855 adding 'lm_eval/tasks/scrolls/task.py' 2026-02-14T10:26:51,857 adding 'lm_eval/tasks/simple_cooccurrence_bias/README.md' 2026-02-14T10:26:51,858 adding 'lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml' 2026-02-14T10:26:51,859 adding 'lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml' 2026-02-14T10:26:51,861 adding 'lm_eval/tasks/simple_cooccurrence_bias/utils.py' 2026-02-14T10:26:51,862 adding 'lm_eval/tasks/siqa/README.md' 2026-02-14T10:26:51,864 adding 'lm_eval/tasks/siqa/siqa.yaml' 2026-02-14T10:26:51,866 adding 'lm_eval/tasks/slr_bench/README.md' 2026-02-14T10:26:51,867 adding 'lm_eval/tasks/slr_bench/lm_eval_slr_bench.py' 2026-02-14T10:26:51,868 adding 'lm_eval/tasks/slr_bench/slr_bench_all.yaml' 2026-02-14T10:26:51,869 adding 'lm_eval/tasks/slr_bench/slr_bench_basic.yaml' 2026-02-14T10:26:51,870 adding 'lm_eval/tasks/slr_bench/slr_bench_common_yaml' 2026-02-14T10:26:51,871 adding 'lm_eval/tasks/slr_bench/slr_bench_easy.yaml' 2026-02-14T10:26:51,873 adding 'lm_eval/tasks/slr_bench/slr_bench_group.yaml' 2026-02-14T10:26:51,874 adding 'lm_eval/tasks/slr_bench/slr_bench_hard.yaml' 2026-02-14T10:26:51,875 adding 'lm_eval/tasks/slr_bench/slr_bench_medium.yaml' 2026-02-14T10:26:51,877 adding 'lm_eval/tasks/spanish_bench/README.md' 2026-02-14T10:26:51,878 adding 'lm_eval/tasks/spanish_bench/cocoteros_es.yaml' 2026-02-14T10:26:51,880 adding 'lm_eval/tasks/spanish_bench/copa_es.yaml' 2026-02-14T10:26:51,881 adding 'lm_eval/tasks/spanish_bench/escola.yaml' 2026-02-14T10:26:51,882 adding 'lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml' 2026-02-14T10:26:51,883 adding 'lm_eval/tasks/spanish_bench/openbookqa_es.yaml' 2026-02-14T10:26:51,884 adding 'lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml' 2026-02-14T10:26:51,886 adding 'lm_eval/tasks/spanish_bench/spanish_bench.yaml' 2026-02-14T10:26:51,887 adding 'lm_eval/tasks/spanish_bench/utils.py' 2026-02-14T10:26:51,888 adding 'lm_eval/tasks/spanish_bench/wnli_es.yaml' 2026-02-14T10:26:51,889 adding 'lm_eval/tasks/spanish_bench/xlsum_es.yaml' 2026-02-14T10:26:51,890 adding 'lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml' 2026-02-14T10:26:51,893 adding 'lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml' 2026-02-14T10:26:51,894 adding 'lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py' 2026-02-14T10:26:51,896 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml' 2026-02-14T10:26:51,897 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml' 2026-02-14T10:26:51,898 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml' 2026-02-14T10:26:51,900 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml' 2026-02-14T10:26:51,901 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml' 2026-02-14T10:26:51,902 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml' 2026-02-14T10:26:51,903 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml' 2026-02-14T10:26:51,905 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml' 2026-02-14T10:26:51,906 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml' 2026-02-14T10:26:51,907 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml' 2026-02-14T10:26:51,908 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml' 2026-02-14T10:26:51,909 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml' 2026-02-14T10:26:51,911 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml' 2026-02-14T10:26:51,912 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml' 2026-02-14T10:26:51,913 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml' 2026-02-14T10:26:51,914 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml' 2026-02-14T10:26:51,915 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml' 2026-02-14T10:26:51,917 adding 'lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common' 2026-02-14T10:26:51,919 adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml' 2026-02-14T10:26:51,920 adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml' 2026-02-14T10:26:51,922 adding 'lm_eval/tasks/squad_completion/README.md' 2026-02-14T10:26:51,923 adding 'lm_eval/tasks/squad_completion/squad_completion.yaml' 2026-02-14T10:26:51,924 adding 'lm_eval/tasks/squad_completion/task.py' 2026-02-14T10:26:51,926 adding 'lm_eval/tasks/squadv2/README.md' 2026-02-14T10:26:51,927 adding 'lm_eval/tasks/squadv2/squadv2.yaml' 2026-02-14T10:26:51,929 adding 'lm_eval/tasks/squadv2/task.py' 2026-02-14T10:26:51,931 adding 'lm_eval/tasks/storycloze/README.md' 2026-02-14T10:26:51,932 adding 'lm_eval/tasks/storycloze/storycloze_2016.yaml' 2026-02-14T10:26:51,933 adding 'lm_eval/tasks/storycloze/storycloze_2018.yaml' 2026-02-14T10:26:51,935 adding 'lm_eval/tasks/super_glue/README.md' 2026-02-14T10:26:51,937 adding 'lm_eval/tasks/super_glue/boolq/default.yaml' 2026-02-14T10:26:51,938 adding 'lm_eval/tasks/super_glue/boolq/seq2seq.yaml' 2026-02-14T10:26:51,939 adding 'lm_eval/tasks/super_glue/boolq/t5-prompt.yaml' 2026-02-14T10:26:51,941 adding 'lm_eval/tasks/super_glue/cb/aggregate.py' 2026-02-14T10:26:51,942 adding 'lm_eval/tasks/super_glue/cb/default.yaml' 2026-02-14T10:26:51,944 adding 'lm_eval/tasks/super_glue/cb/t5-prompt.yaml' 2026-02-14T10:26:51,945 adding 'lm_eval/tasks/super_glue/cb/t5_utils.py' 2026-02-14T10:26:51,947 adding 'lm_eval/tasks/super_glue/copa/default.yaml' 2026-02-14T10:26:51,948 adding 'lm_eval/tasks/super_glue/copa/t5-prompt.yaml' 2026-02-14T10:26:51,949 adding 'lm_eval/tasks/super_glue/copa/utils.py' 2026-02-14T10:26:51,951 adding 'lm_eval/tasks/super_glue/multirc/default.yaml' 2026-02-14T10:26:51,952 adding 'lm_eval/tasks/super_glue/multirc/t5-prompt.yaml' 2026-02-14T10:26:51,953 adding 'lm_eval/tasks/super_glue/multirc/t5_utils.py' 2026-02-14T10:26:51,955 adding 'lm_eval/tasks/super_glue/record/default.yaml' 2026-02-14T10:26:51,957 adding 'lm_eval/tasks/super_glue/record/t5-prompt.yaml' 2026-02-14T10:26:51,958 adding 'lm_eval/tasks/super_glue/record/t5_utils.py' 2026-02-14T10:26:51,959 adding 'lm_eval/tasks/super_glue/record/util.py' 2026-02-14T10:26:51,961 adding 'lm_eval/tasks/super_glue/rte/default.yaml' 2026-02-14T10:26:51,963 adding 'lm_eval/tasks/super_glue/rte/t5-prompt.yaml' 2026-02-14T10:26:51,965 adding 'lm_eval/tasks/super_glue/wic/default.yaml' 2026-02-14T10:26:51,966 adding 'lm_eval/tasks/super_glue/wic/t5-prompt.yaml' 2026-02-14T10:26:51,968 adding 'lm_eval/tasks/super_glue/wsc/default.yaml' 2026-02-14T10:26:51,970 adding 'lm_eval/tasks/super_glue/wsc/preprocess_wsc.py' 2026-02-14T10:26:51,971 adding 'lm_eval/tasks/super_glue/wsc/t5-prompt.yaml' 2026-02-14T10:26:51,972 adding 'lm_eval/tasks/super_glue/wsc/t5_utils.py' 2026-02-14T10:26:51,974 adding 'lm_eval/tasks/swag/README.md' 2026-02-14T10:26:51,975 adding 'lm_eval/tasks/swag/swag.yaml' 2026-02-14T10:26:51,977 adding 'lm_eval/tasks/swde/README.md' 2026-02-14T10:26:51,979 adding 'lm_eval/tasks/swde/swde.yaml' 2026-02-14T10:26:51,980 adding 'lm_eval/tasks/swde/task.py' 2026-02-14T10:26:51,982 adding 'lm_eval/tasks/tinyBenchmarks/README.md' 2026-02-14T10:26:51,984 adding 'lm_eval/tasks/tinyBenchmarks/agg_functions.py' 2026-02-14T10:26:51,985 adding 'lm_eval/tasks/tinyBenchmarks/tinyArc.yaml' 2026-02-14T10:26:51,986 adding 'lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml' 2026-02-14T10:26:51,988 adding 'lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml' 2026-02-14T10:26:51,989 adding 'lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml' 2026-02-14T10:26:51,990 adding 'lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml' 2026-02-14T10:26:51,991 adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml' 2026-02-14T10:26:51,993 adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml' 2026-02-14T10:26:51,994 adding 'lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml' 2026-02-14T10:26:51,995 adding 'lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py' 2026-02-14T10:26:51,997 adding 'lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py' 2026-02-14T10:26:51,999 adding 'lm_eval/tasks/tinyBenchmarks/utils_winogrande.py' 2026-02-14T10:26:52,001 adding 'lm_eval/tasks/tmlu/README.md' 2026-02-14T10:26:52,002 adding 'lm_eval/tasks/tmlu/subject.tsv' 2026-02-14T10:26:52,004 adding 'lm_eval/tasks/tmlu/default/_default_template_yaml' 2026-02-14T10:26:52,006 adding 'lm_eval/tasks/tmlu/default/_generate_configs.py' 2026-02-14T10:26:52,007 adding 'lm_eval/tasks/tmlu/default/_tmlu.yaml' 2026-02-14T10:26:52,009 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml' 2026-02-14T10:26:52,010 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml' 2026-02-14T10:26:52,011 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml' 2026-02-14T10:26:52,012 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml' 2026-02-14T10:26:52,021 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml' 2026-02-14T10:26:52,022 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml' 2026-02-14T10:26:52,023 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml' 2026-02-14T10:26:52,024 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml' 2026-02-14T10:26:52,026 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml' 2026-02-14T10:26:52,027 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml' 2026-02-14T10:26:52,028 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml' 2026-02-14T10:26:52,029 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml' 2026-02-14T10:26:52,031 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml' 2026-02-14T10:26:52,032 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml' 2026-02-14T10:26:52,033 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml' 2026-02-14T10:26:52,034 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml' 2026-02-14T10:26:52,035 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml' 2026-02-14T10:26:52,037 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml' 2026-02-14T10:26:52,038 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml' 2026-02-14T10:26:52,039 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml' 2026-02-14T10:26:52,040 adding 'lm_eval/tasks/tmlu/default/tmlu_accountant.yaml' 2026-02-14T10:26:52,042 adding 'lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml' 2026-02-14T10:26:52,043 adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml' 2026-02-14T10:26:52,044 adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml' 2026-02-14T10:26:52,045 adding 'lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml' 2026-02-14T10:26:52,047 adding 'lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml' 2026-02-14T10:26:52,048 adding 'lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml' 2026-02-14T10:26:52,049 adding 'lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml' 2026-02-14T10:26:52,050 adding 'lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml' 2026-02-14T10:26:52,052 adding 'lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml' 2026-02-14T10:26:52,053 adding 'lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml' 2026-02-14T10:26:52,054 adding 'lm_eval/tasks/tmlu/default/utils.py' 2026-02-14T10:26:52,056 adding 'lm_eval/tasks/tmmluplus/README.md' 2026-02-14T10:26:52,058 adding 'lm_eval/tasks/tmmluplus/subject.tsv' 2026-02-14T10:26:52,061 adding 'lm_eval/tasks/tmmluplus/default/_generate_configs.py' 2026-02-14T10:26:52,062 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml' 2026-02-14T10:26:52,064 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml' 2026-02-14T10:26:52,065 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml' 2026-02-14T10:26:52,066 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml' 2026-02-14T10:26:52,067 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml' 2026-02-14T10:26:52,068 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml' 2026-02-14T10:26:52,070 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml' 2026-02-14T10:26:52,071 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml' 2026-02-14T10:26:52,072 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml' 2026-02-14T10:26:52,073 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml' 2026-02-14T10:26:52,074 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml' 2026-02-14T10:26:52,076 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml' 2026-02-14T10:26:52,077 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml' 2026-02-14T10:26:52,078 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml' 2026-02-14T10:26:52,079 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml' 2026-02-14T10:26:52,080 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml' 2026-02-14T10:26:52,081 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml' 2026-02-14T10:26:52,083 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml' 2026-02-14T10:26:52,084 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml' 2026-02-14T10:26:52,085 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml' 2026-02-14T10:26:52,086 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml' 2026-02-14T10:26:52,088 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml' 2026-02-14T10:26:52,089 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml' 2026-02-14T10:26:52,090 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml' 2026-02-14T10:26:52,091 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml' 2026-02-14T10:26:52,092 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml' 2026-02-14T10:26:52,094 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml' 2026-02-14T10:26:52,095 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml' 2026-02-14T10:26:52,096 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml' 2026-02-14T10:26:52,097 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml' 2026-02-14T10:26:52,098 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml' 2026-02-14T10:26:52,100 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml' 2026-02-14T10:26:52,101 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml' 2026-02-14T10:26:52,102 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml' 2026-02-14T10:26:52,103 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml' 2026-02-14T10:26:52,105 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml' 2026-02-14T10:26:52,106 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml' 2026-02-14T10:26:52,107 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml' 2026-02-14T10:26:52,108 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml' 2026-02-14T10:26:52,110 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml' 2026-02-14T10:26:52,111 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml' 2026-02-14T10:26:52,112 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml' 2026-02-14T10:26:52,113 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml' 2026-02-14T10:26:52,114 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml' 2026-02-14T10:26:52,116 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml' 2026-02-14T10:26:52,117 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml' 2026-02-14T10:26:52,118 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml' 2026-02-14T10:26:52,119 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml' 2026-02-14T10:26:52,121 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml' 2026-02-14T10:26:52,122 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml' 2026-02-14T10:26:52,123 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml' 2026-02-14T10:26:52,124 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml' 2026-02-14T10:26:52,125 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml' 2026-02-14T10:26:52,126 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml' 2026-02-14T10:26:52,127 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml' 2026-02-14T10:26:52,129 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml' 2026-02-14T10:26:52,130 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml' 2026-02-14T10:26:52,131 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml' 2026-02-14T10:26:52,132 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml' 2026-02-14T10:26:52,133 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml' 2026-02-14T10:26:52,134 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml' 2026-02-14T10:26:52,135 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml' 2026-02-14T10:26:52,137 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml' 2026-02-14T10:26:52,138 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml' 2026-02-14T10:26:52,139 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml' 2026-02-14T10:26:52,140 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml' 2026-02-14T10:26:52,141 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml' 2026-02-14T10:26:52,142 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml' 2026-02-14T10:26:52,143 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml' 2026-02-14T10:26:52,145 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml' 2026-02-14T10:26:52,146 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml' 2026-02-14T10:26:52,147 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml' 2026-02-14T10:26:52,148 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml' 2026-02-14T10:26:52,149 adding 'lm_eval/tasks/tmmluplus/default/utils.py' 2026-02-14T10:26:52,151 adding 'lm_eval/tasks/toxigen/README.md' 2026-02-14T10:26:52,152 adding 'lm_eval/tasks/toxigen/toxigen.yaml' 2026-02-14T10:26:52,154 adding 'lm_eval/tasks/toxigen/utils.py' 2026-02-14T10:26:52,155 adding 'lm_eval/tasks/translation/README.md' 2026-02-14T10:26:52,157 adding 'lm_eval/tasks/translation/iwslt2017_ar-en.yaml' 2026-02-14T10:26:52,158 adding 'lm_eval/tasks/translation/iwslt2017_en-ar.yaml' 2026-02-14T10:26:52,159 adding 'lm_eval/tasks/translation/utils.py' 2026-02-14T10:26:52,160 adding 'lm_eval/tasks/translation/wmt14_en-fr.yaml' 2026-02-14T10:26:52,162 adding 'lm_eval/tasks/translation/wmt14_fr-en.yaml' 2026-02-14T10:26:52,163 adding 'lm_eval/tasks/translation/wmt16_de-en.yaml' 2026-02-14T10:26:52,164 adding 'lm_eval/tasks/translation/wmt16_en-de.yaml' 2026-02-14T10:26:52,165 adding 'lm_eval/tasks/translation/wmt16_en-ro.yaml' 2026-02-14T10:26:52,167 adding 'lm_eval/tasks/translation/wmt16_ro-en.yaml' 2026-02-14T10:26:52,168 adding 'lm_eval/tasks/translation/wmt_common_yaml' 2026-02-14T10:26:52,170 adding 'lm_eval/tasks/triviaqa/README.md' 2026-02-14T10:26:52,171 adding 'lm_eval/tasks/triviaqa/default.yaml' 2026-02-14T10:26:52,173 adding 'lm_eval/tasks/truthfulqa/README.md' 2026-02-14T10:26:52,174 adding 'lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml' 2026-02-14T10:26:52,175 adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml' 2026-02-14T10:26:52,177 adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml' 2026-02-14T10:26:52,179 adding 'lm_eval/tasks/truthfulqa/utils.py' 2026-02-14T10:26:52,181 adding 'lm_eval/tasks/truthfulqa-multi/README.md' 2026-02-14T10:26:52,182 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml' 2026-02-14T10:26:52,183 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common' 2026-02-14T10:26:52,184 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml' 2026-02-14T10:26:52,185 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml' 2026-02-14T10:26:52,186 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml' 2026-02-14T10:26:52,187 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml' 2026-02-14T10:26:52,189 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml' 2026-02-14T10:26:52,190 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml' 2026-02-14T10:26:52,191 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml' 2026-02-14T10:26:52,192 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml' 2026-02-14T10:26:52,193 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml' 2026-02-14T10:26:52,194 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml' 2026-02-14T10:26:52,195 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml' 2026-02-14T10:26:52,196 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml' 2026-02-14T10:26:52,197 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml' 2026-02-14T10:26:52,199 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml' 2026-02-14T10:26:52,200 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common' 2026-02-14T10:26:52,201 adding 'lm_eval/tasks/truthfulqa-multi/utils.py' 2026-02-14T10:26:52,204 adding 'lm_eval/tasks/turblimp/README.md' 2026-02-14T10:26:52,205 adding 'lm_eval/tasks/turblimp/_template_yaml' 2026-02-14T10:26:52,206 adding 'lm_eval/tasks/turblimp/anaphor_agreement.yaml' 2026-02-14T10:26:52,207 adding 'lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml' 2026-02-14T10:26:52,208 adding 'lm_eval/tasks/turblimp/argument_structure_transitive.yaml' 2026-02-14T10:26:52,209 adding 'lm_eval/tasks/turblimp/binding.yaml' 2026-02-14T10:26:52,211 adding 'lm_eval/tasks/turblimp/determiners.yaml' 2026-02-14T10:26:52,212 adding 'lm_eval/tasks/turblimp/ellipsis.yaml' 2026-02-14T10:26:52,213 adding 'lm_eval/tasks/turblimp/irregular_forms.yaml' 2026-02-14T10:26:52,214 adding 'lm_eval/tasks/turblimp/island_effects.yaml' 2026-02-14T10:26:52,215 adding 'lm_eval/tasks/turblimp/nominalization.yaml' 2026-02-14T10:26:52,216 adding 'lm_eval/tasks/turblimp/npi_licensing.yaml' 2026-02-14T10:26:52,218 adding 'lm_eval/tasks/turblimp/passives.yaml' 2026-02-14T10:26:52,219 adding 'lm_eval/tasks/turblimp/quantifiers.yaml' 2026-02-14T10:26:52,220 adding 'lm_eval/tasks/turblimp/relative_clauses.yaml' 2026-02-14T10:26:52,221 adding 'lm_eval/tasks/turblimp/scrambling.yaml' 2026-02-14T10:26:52,223 adding 'lm_eval/tasks/turblimp/subject_agreement.yaml' 2026-02-14T10:26:52,224 adding 'lm_eval/tasks/turblimp/suspended_affixation.yaml' 2026-02-14T10:26:52,225 adding 'lm_eval/tasks/turblimp/turblimp_group.yaml' 2026-02-14T10:26:52,227 adding 'lm_eval/tasks/turkishmmlu/README.md' 2026-02-14T10:26:52,229 adding 'lm_eval/tasks/turkishmmlu/config/Biology.yaml' 2026-02-14T10:26:52,230 adding 'lm_eval/tasks/turkishmmlu/config/Chemistry.yaml' 2026-02-14T10:26:52,232 adding 'lm_eval/tasks/turkishmmlu/config/Geography.yaml' 2026-02-14T10:26:52,233 adding 'lm_eval/tasks/turkishmmlu/config/History.yaml' 2026-02-14T10:26:52,234 adding 'lm_eval/tasks/turkishmmlu/config/Mathematics.yaml' 2026-02-14T10:26:52,235 adding 'lm_eval/tasks/turkishmmlu/config/Philosophy.yaml' 2026-02-14T10:26:52,236 adding 'lm_eval/tasks/turkishmmlu/config/Physics.yaml' 2026-02-14T10:26:52,238 adding 'lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml' 2026-02-14T10:26:52,239 adding 'lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml' 2026-02-14T10:26:52,240 adding 'lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml' 2026-02-14T10:26:52,242 adding 'lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml' 2026-02-14T10:26:52,245 adding 'lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml' 2026-02-14T10:26:52,246 adding 'lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml' 2026-02-14T10:26:52,248 adding 'lm_eval/tasks/turkishmmlu/config_cot/History.yaml' 2026-02-14T10:26:52,249 adding 'lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml' 2026-02-14T10:26:52,251 adding 'lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml' 2026-02-14T10:26:52,253 adding 'lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml' 2026-02-14T10:26:52,255 adding 'lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml' 2026-02-14T10:26:52,256 adding 'lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml' 2026-02-14T10:26:52,257 adding 'lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml' 2026-02-14T10:26:52,259 adding 'lm_eval/tasks/ulqa/README.md' 2026-02-14T10:26:52,261 adding 'lm_eval/tasks/ulqa/celep1.yaml' 2026-02-14T10:26:52,262 adding 'lm_eval/tasks/ulqa/celep2.yaml' 2026-02-14T10:26:52,263 adding 'lm_eval/tasks/ulqa/lambada_uyghur.yaml' 2026-02-14T10:26:52,264 adding 'lm_eval/tasks/ulqa/uleval.yaml' 2026-02-14T10:26:52,266 adding 'lm_eval/tasks/ulqa/ulqa.yaml' 2026-02-14T10:26:52,267 adding 'lm_eval/tasks/ulqa/ulqa_.yaml' 2026-02-14T10:26:52,269 adding 'lm_eval/tasks/ulqa/ulut/nug.yaml' 2026-02-14T10:26:52,270 adding 'lm_eval/tasks/ulqa/ulut/ulut.yaml' 2026-02-14T10:26:52,271 adding 'lm_eval/tasks/ulqa/ulut/wag.yaml' 2026-02-14T10:26:52,272 adding 'lm_eval/tasks/ulqa/ulut/wsm.yaml' 2026-02-14T10:26:52,273 adding 'lm_eval/tasks/ulqa/ulut/wub.yaml' 2026-02-14T10:26:52,275 adding 'lm_eval/tasks/ulqa/ulut/wum.yaml' 2026-02-14T10:26:52,277 adding 'lm_eval/tasks/unitxt/20_newsgroups.yaml' 2026-02-14T10:26:52,278 adding 'lm_eval/tasks/unitxt/README.md' 2026-02-14T10:26:52,279 adding 'lm_eval/tasks/unitxt/ag_news.yaml' 2026-02-14T10:26:52,281 adding 'lm_eval/tasks/unitxt/argument_topic.yaml' 2026-02-14T10:26:52,282 adding 'lm_eval/tasks/unitxt/atis.yaml' 2026-02-14T10:26:52,283 adding 'lm_eval/tasks/unitxt/banking77.yaml' 2026-02-14T10:26:52,284 adding 'lm_eval/tasks/unitxt/claim_stance_topic.yaml' 2026-02-14T10:26:52,285 adding 'lm_eval/tasks/unitxt/cnn_dailymail.yaml' 2026-02-14T10:26:52,287 adding 'lm_eval/tasks/unitxt/coedit_gec.yaml' 2026-02-14T10:26:52,288 adding 'lm_eval/tasks/unitxt/dbpedia_14.yaml' 2026-02-14T10:26:52,289 adding 'lm_eval/tasks/unitxt/doc_vqa.yaml' 2026-02-14T10:26:52,290 adding 'lm_eval/tasks/unitxt/ethos_binary.yaml' 2026-02-14T10:26:52,291 adding 'lm_eval/tasks/unitxt/financial_tweets.yaml' 2026-02-14T10:26:52,292 adding 'lm_eval/tasks/unitxt/law_stack_exchange.yaml' 2026-02-14T10:26:52,293 adding 'lm_eval/tasks/unitxt/ledgar.yaml' 2026-02-14T10:26:52,295 adding 'lm_eval/tasks/unitxt/medical_abstracts.yaml' 2026-02-14T10:26:52,296 adding 'lm_eval/tasks/unitxt/stsb.yaml' 2026-02-14T10:26:52,298 adding 'lm_eval/tasks/unitxt/task.py' 2026-02-14T10:26:52,299 adding 'lm_eval/tasks/unitxt/unfair_tos.yaml' 2026-02-14T10:26:52,300 adding 'lm_eval/tasks/unitxt/unitxt' 2026-02-14T10:26:52,301 adding 'lm_eval/tasks/unitxt/unitxt_multimodal' 2026-02-14T10:26:52,302 adding 'lm_eval/tasks/unitxt/xsum.yaml' 2026-02-14T10:26:52,303 adding 'lm_eval/tasks/unitxt/yahoo_answers_topics.yaml' 2026-02-14T10:26:52,305 adding 'lm_eval/tasks/unscramble/README.md' 2026-02-14T10:26:52,306 adding 'lm_eval/tasks/unscramble/anagrams1.yaml' 2026-02-14T10:26:52,308 adding 'lm_eval/tasks/unscramble/anagrams2.yaml' 2026-02-14T10:26:52,309 adding 'lm_eval/tasks/unscramble/cycle_letters.yaml' 2026-02-14T10:26:52,310 adding 'lm_eval/tasks/unscramble/random_insertion.yaml' 2026-02-14T10:26:52,311 adding 'lm_eval/tasks/unscramble/reversed_words.yaml' 2026-02-14T10:26:52,314 adding 'lm_eval/tasks/webqs/README.md' 2026-02-14T10:26:52,315 adding 'lm_eval/tasks/webqs/utils.py' 2026-02-14T10:26:52,316 adding 'lm_eval/tasks/webqs/webqs.yaml' 2026-02-14T10:26:52,318 adding 'lm_eval/tasks/wikitext/README.md' 2026-02-14T10:26:52,319 adding 'lm_eval/tasks/wikitext/preprocess_wikitext.py' 2026-02-14T10:26:52,320 adding 'lm_eval/tasks/wikitext/wikitext.yaml' 2026-02-14T10:26:52,322 adding 'lm_eval/tasks/winogender/README.md' 2026-02-14T10:26:52,323 adding 'lm_eval/tasks/winogender/utils.py' 2026-02-14T10:26:52,325 adding 'lm_eval/tasks/winogender/winogender.yaml' 2026-02-14T10:26:52,326 adding 'lm_eval/tasks/winogender/winogender_female.yaml' 2026-02-14T10:26:52,327 adding 'lm_eval/tasks/winogender/winogender_gotcha.yaml' 2026-02-14T10:26:52,328 adding 'lm_eval/tasks/winogender/winogender_gotcha_female.yaml' 2026-02-14T10:26:52,329 adding 'lm_eval/tasks/winogender/winogender_gotcha_male.yaml' 2026-02-14T10:26:52,330 adding 'lm_eval/tasks/winogender/winogender_male.yaml' 2026-02-14T10:26:52,331 adding 'lm_eval/tasks/winogender/winogender_neutral.yaml' 2026-02-14T10:26:52,334 adding 'lm_eval/tasks/winogrande/README.md' 2026-02-14T10:26:52,335 adding 'lm_eval/tasks/winogrande/default.yaml' 2026-02-14T10:26:52,336 adding 'lm_eval/tasks/winogrande/preprocess_winogrande.py' 2026-02-14T10:26:52,338 adding 'lm_eval/tasks/wmdp/README.md' 2026-02-14T10:26:52,339 adding 'lm_eval/tasks/wmdp/_default_template_yaml' 2026-02-14T10:26:52,340 adding 'lm_eval/tasks/wmdp/_wmdp.yaml' 2026-02-14T10:26:52,341 adding 'lm_eval/tasks/wmdp/wmdp_bio.yaml' 2026-02-14T10:26:52,342 adding 'lm_eval/tasks/wmdp/wmdp_chem.yaml' 2026-02-14T10:26:52,343 adding 'lm_eval/tasks/wmdp/wmdp_cyber.yaml' 2026-02-14T10:26:52,345 adding 'lm_eval/tasks/wmt2016/README.md' 2026-02-14T10:26:52,347 adding 'lm_eval/tasks/wmt2016/metrics.py' 2026-02-14T10:26:52,348 adding 'lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml' 2026-02-14T10:26:52,350 adding 'lm_eval/tasks/wsc273/README.md' 2026-02-14T10:26:52,351 adding 'lm_eval/tasks/wsc273/default.yaml' 2026-02-14T10:26:52,352 adding 'lm_eval/tasks/wsc273/utils.py' 2026-02-14T10:26:52,354 adding 'lm_eval/tasks/xcopa/README.md' 2026-02-14T10:26:52,355 adding 'lm_eval/tasks/xcopa/_xcopa.yaml' 2026-02-14T10:26:52,357 adding 'lm_eval/tasks/xcopa/default_et.yaml' 2026-02-14T10:26:52,358 adding 'lm_eval/tasks/xcopa/default_ht.yaml' 2026-02-14T10:26:52,359 adding 'lm_eval/tasks/xcopa/default_id.yaml' 2026-02-14T10:26:52,360 adding 'lm_eval/tasks/xcopa/default_it.yaml' 2026-02-14T10:26:52,361 adding 'lm_eval/tasks/xcopa/default_qu.yaml' 2026-02-14T10:26:52,362 adding 'lm_eval/tasks/xcopa/default_sw.yaml' 2026-02-14T10:26:52,364 adding 'lm_eval/tasks/xcopa/default_ta.yaml' 2026-02-14T10:26:52,365 adding 'lm_eval/tasks/xcopa/default_th.yaml' 2026-02-14T10:26:52,366 adding 'lm_eval/tasks/xcopa/default_tr.yaml' 2026-02-14T10:26:52,367 adding 'lm_eval/tasks/xcopa/default_vi.yaml' 2026-02-14T10:26:52,368 adding 'lm_eval/tasks/xcopa/default_zh.yaml' 2026-02-14T10:26:52,369 adding 'lm_eval/tasks/xcopa/utils.py' 2026-02-14T10:26:52,371 adding 'lm_eval/tasks/xnli/README.md' 2026-02-14T10:26:52,373 adding 'lm_eval/tasks/xnli/_xnli.yaml' 2026-02-14T10:26:52,374 adding 'lm_eval/tasks/xnli/utils.py' 2026-02-14T10:26:52,376 adding 'lm_eval/tasks/xnli/xnli_ar.yaml' 2026-02-14T10:26:52,377 adding 'lm_eval/tasks/xnli/xnli_bg.yaml' 2026-02-14T10:26:52,378 adding 'lm_eval/tasks/xnli/xnli_common_yaml' 2026-02-14T10:26:52,379 adding 'lm_eval/tasks/xnli/xnli_de.yaml' 2026-02-14T10:26:52,380 adding 'lm_eval/tasks/xnli/xnli_el.yaml' 2026-02-14T10:26:52,382 adding 'lm_eval/tasks/xnli/xnli_en.yaml' 2026-02-14T10:26:52,383 adding 'lm_eval/tasks/xnli/xnli_es.yaml' 2026-02-14T10:26:52,384 adding 'lm_eval/tasks/xnli/xnli_fr.yaml' 2026-02-14T10:26:52,385 adding 'lm_eval/tasks/xnli/xnli_hi.yaml' 2026-02-14T10:26:52,386 adding 'lm_eval/tasks/xnli/xnli_ru.yaml' 2026-02-14T10:26:52,388 adding 'lm_eval/tasks/xnli/xnli_sw.yaml' 2026-02-14T10:26:52,389 adding 'lm_eval/tasks/xnli/xnli_th.yaml' 2026-02-14T10:26:52,390 adding 'lm_eval/tasks/xnli/xnli_tr.yaml' 2026-02-14T10:26:52,391 adding 'lm_eval/tasks/xnli/xnli_ur.yaml' 2026-02-14T10:26:52,392 adding 'lm_eval/tasks/xnli/xnli_vi.yaml' 2026-02-14T10:26:52,393 adding 'lm_eval/tasks/xnli/xnli_zh.yaml' 2026-02-14T10:26:52,395 adding 'lm_eval/tasks/xnli_eu/README.md' 2026-02-14T10:26:52,396 adding 'lm_eval/tasks/xnli_eu/xnli_common_yaml' 2026-02-14T10:26:52,397 adding 'lm_eval/tasks/xnli_eu/xnli_eu.yaml' 2026-02-14T10:26:52,398 adding 'lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml' 2026-02-14T10:26:52,399 adding 'lm_eval/tasks/xnli_eu/xnli_eu_native.yaml' 2026-02-14T10:26:52,401 adding 'lm_eval/tasks/xquad/README.md' 2026-02-14T10:26:52,402 adding 'lm_eval/tasks/xquad/utils.py' 2026-02-14T10:26:52,403 adding 'lm_eval/tasks/xquad/xquad_ar.yaml' 2026-02-14T10:26:52,405 adding 'lm_eval/tasks/xquad/xquad_common_yaml' 2026-02-14T10:26:52,406 adding 'lm_eval/tasks/xquad/xquad_de.yaml' 2026-02-14T10:26:52,407 adding 'lm_eval/tasks/xquad/xquad_el.yaml' 2026-02-14T10:26:52,408 adding 'lm_eval/tasks/xquad/xquad_en.yaml' 2026-02-14T10:26:52,409 adding 'lm_eval/tasks/xquad/xquad_es.yaml' 2026-02-14T10:26:52,410 adding 'lm_eval/tasks/xquad/xquad_hi.yaml' 2026-02-14T10:26:52,411 adding 'lm_eval/tasks/xquad/xquad_ro.yaml' 2026-02-14T10:26:52,413 adding 'lm_eval/tasks/xquad/xquad_ru.yaml' 2026-02-14T10:26:52,414 adding 'lm_eval/tasks/xquad/xquad_th.yaml' 2026-02-14T10:26:52,415 adding 'lm_eval/tasks/xquad/xquad_tr.yaml' 2026-02-14T10:26:52,416 adding 'lm_eval/tasks/xquad/xquad_vi.yaml' 2026-02-14T10:26:52,417 adding 'lm_eval/tasks/xquad/xquad_zh.yaml' 2026-02-14T10:26:52,419 adding 'lm_eval/tasks/xstorycloze/README.md' 2026-02-14T10:26:52,420 adding 'lm_eval/tasks/xstorycloze/_xstorycloze.yaml' 2026-02-14T10:26:52,421 adding 'lm_eval/tasks/xstorycloze/default_ar.yaml' 2026-02-14T10:26:52,422 adding 'lm_eval/tasks/xstorycloze/default_en.yaml' 2026-02-14T10:26:52,423 adding 'lm_eval/tasks/xstorycloze/default_es.yaml' 2026-02-14T10:26:52,424 adding 'lm_eval/tasks/xstorycloze/default_eu.yaml' 2026-02-14T10:26:52,426 adding 'lm_eval/tasks/xstorycloze/default_hi.yaml' 2026-02-14T10:26:52,427 adding 'lm_eval/tasks/xstorycloze/default_id.yaml' 2026-02-14T10:26:52,428 adding 'lm_eval/tasks/xstorycloze/default_my.yaml' 2026-02-14T10:26:52,429 adding 'lm_eval/tasks/xstorycloze/default_ru.yaml' 2026-02-14T10:26:52,430 adding 'lm_eval/tasks/xstorycloze/default_sw.yaml' 2026-02-14T10:26:52,431 adding 'lm_eval/tasks/xstorycloze/default_te.yaml' 2026-02-14T10:26:52,432 adding 'lm_eval/tasks/xstorycloze/default_zh.yaml' 2026-02-14T10:26:52,434 adding 'lm_eval/tasks/xwinograd/README.md' 2026-02-14T10:26:52,436 adding 'lm_eval/tasks/xwinograd/_xwinograd.yaml' 2026-02-14T10:26:52,437 adding 'lm_eval/tasks/xwinograd/utils.py' 2026-02-14T10:26:52,438 adding 'lm_eval/tasks/xwinograd/xwinograd_common_yaml' 2026-02-14T10:26:52,439 adding 'lm_eval/tasks/xwinograd/xwinograd_en.yaml' 2026-02-14T10:26:52,441 adding 'lm_eval/tasks/xwinograd/xwinograd_fr.yaml' 2026-02-14T10:26:52,442 adding 'lm_eval/tasks/xwinograd/xwinograd_jp.yaml' 2026-02-14T10:26:52,443 adding 'lm_eval/tasks/xwinograd/xwinograd_pt.yaml' 2026-02-14T10:26:52,444 adding 'lm_eval/tasks/xwinograd/xwinograd_ru.yaml' 2026-02-14T10:26:52,445 adding 'lm_eval/tasks/xwinograd/xwinograd_zh.yaml' 2026-02-14T10:26:52,449 adding 'lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml' 2026-02-14T10:26:52,450 adding 'lm_eval/tasks/zhoblimp/BA_deletion.yaml' 2026-02-14T10:26:52,451 adding 'lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml' 2026-02-14T10:26:52,453 adding 'lm_eval/tasks/zhoblimp/BA_inversion.yaml' 2026-02-14T10:26:52,454 adding 'lm_eval/tasks/zhoblimp/BA_meiba.yaml' 2026-02-14T10:26:52,455 adding 'lm_eval/tasks/zhoblimp/BA_negation.yaml' 2026-02-14T10:26:52,456 adding 'lm_eval/tasks/zhoblimp/BA_no_progressive.yaml' 2026-02-14T10:26:52,457 adding 'lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml' 2026-02-14T10:26:52,458 adding 'lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml' 2026-02-14T10:26:52,459 adding 'lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml' 2026-02-14T10:26:52,461 adding 'lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml' 2026-02-14T10:26:52,462 adding 'lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml' 2026-02-14T10:26:52,463 adding 'lm_eval/tasks/zhoblimp/BEI_construction_a.yaml' 2026-02-14T10:26:52,464 adding 'lm_eval/tasks/zhoblimp/BEI_construction_b.yaml' 2026-02-14T10:26:52,465 adding 'lm_eval/tasks/zhoblimp/BEI_deletion.yaml' 2026-02-14T10:26:52,466 adding 'lm_eval/tasks/zhoblimp/BEI_preposition.yaml' 2026-02-14T10:26:52,467 adding 'lm_eval/tasks/zhoblimp/PN_numP_a.yaml' 2026-02-14T10:26:52,468 adding 'lm_eval/tasks/zhoblimp/PN_numP_b.yaml' 2026-02-14T10:26:52,469 adding 'lm_eval/tasks/zhoblimp/README.md' 2026-02-14T10:26:52,470 adding 'lm_eval/tasks/zhoblimp/_template_yaml' 2026-02-14T10:26:52,471 adding 'lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml' 2026-02-14T10:26:52,472 adding 'lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml' 2026-02-14T10:26:52,474 adding 'lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml' 2026-02-14T10:26:52,475 adding 'lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml' 2026-02-14T10:26:52,476 adding 'lm_eval/tasks/zhoblimp/agent_causative.yaml' 2026-02-14T10:26:52,477 adding 'lm_eval/tasks/zhoblimp/agent_deletion.yaml' 2026-02-14T10:26:52,478 adding 'lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml' 2026-02-14T10:26:52,479 adding 'lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml' 2026-02-14T10:26:52,480 adding 'lm_eval/tasks/zhoblimp/causative_shi_ba.yaml' 2026-02-14T10:26:52,482 adding 'lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml' 2026-02-14T10:26:52,483 adding 'lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml' 2026-02-14T10:26:52,484 adding 'lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml' 2026-02-14T10:26:52,485 adding 'lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml' 2026-02-14T10:26:52,486 adding 'lm_eval/tasks/zhoblimp/ellipsis_adj.yaml' 2026-02-14T10:26:52,487 adding 'lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml' 2026-02-14T10:26:52,488 adding 'lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml' 2026-02-14T10:26:52,490 adding 'lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml' 2026-02-14T10:26:52,491 adding 'lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml' 2026-02-14T10:26:52,492 adding 'lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml' 2026-02-14T10:26:52,493 adding 'lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml' 2026-02-14T10:26:52,494 adding 'lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml' 2026-02-14T10:26:52,495 adding 'lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml' 2026-02-14T10:26:52,496 adding 'lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml' 2026-02-14T10:26:52,498 adding 'lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml' 2026-02-14T10:26:52,499 adding 'lm_eval/tasks/zhoblimp/left_adverbial_b.yaml' 2026-02-14T10:26:52,500 adding 'lm_eval/tasks/zhoblimp/left_adverbial_d.yaml' 2026-02-14T10:26:52,501 adding 'lm_eval/tasks/zhoblimp/left_adverbial_e.yaml' 2026-02-14T10:26:52,502 adding 'lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml' 2026-02-14T10:26:52,503 adding 'lm_eval/tasks/zhoblimp/left_dou.yaml' 2026-02-14T10:26:52,504 adding 'lm_eval/tasks/zhoblimp/modal_raising_hui.yaml' 2026-02-14T10:26:52,506 adding 'lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml' 2026-02-14T10:26:52,507 adding 'lm_eval/tasks/zhoblimp/nominal_definite_men.yaml' 2026-02-14T10:26:52,508 adding 'lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml' 2026-02-14T10:26:52,509 adding 'lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml' 2026-02-14T10:26:52,510 adding 'lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml' 2026-02-14T10:26:52,511 adding 'lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml' 2026-02-14T10:26:52,512 adding 'lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml' 2026-02-14T10:26:52,514 adding 'lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml' 2026-02-14T10:26:52,515 adding 'lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml' 2026-02-14T10:26:52,516 adding 'lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml' 2026-02-14T10:26:52,517 adding 'lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml' 2026-02-14T10:26:52,518 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml' 2026-02-14T10:26:52,519 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml' 2026-02-14T10:26:52,520 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml' 2026-02-14T10:26:52,521 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml' 2026-02-14T10:26:52,522 adding 'lm_eval/tasks/zhoblimp/passive_body_part.yaml' 2026-02-14T10:26:52,523 adding 'lm_eval/tasks/zhoblimp/passive_intransitive.yaml' 2026-02-14T10:26:52,525 adding 'lm_eval/tasks/zhoblimp/passive_no_adj.yaml' 2026-02-14T10:26:52,526 adding 'lm_eval/tasks/zhoblimp/passive_suo.yaml' 2026-02-14T10:26:52,527 adding 'lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml' 2026-02-14T10:26:52,528 adding 'lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml' 2026-02-14T10:26:52,529 adding 'lm_eval/tasks/zhoblimp/preposition_deletion.yaml' 2026-02-14T10:26:52,530 adding 'lm_eval/tasks/zhoblimp/preposition_insertion.yaml' 2026-02-14T10:26:52,531 adding 'lm_eval/tasks/zhoblimp/principle_A_c_command.yaml' 2026-02-14T10:26:52,533 adding 'lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml' 2026-02-14T10:26:52,534 adding 'lm_eval/tasks/zhoblimp/principle_A_domain.yaml' 2026-02-14T10:26:52,535 adding 'lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml' 2026-02-14T10:26:52,536 adding 'lm_eval/tasks/zhoblimp/question_A_not_A.yaml' 2026-02-14T10:26:52,537 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml' 2026-02-14T10:26:52,538 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml' 2026-02-14T10:26:52,539 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml' 2026-02-14T10:26:52,540 adding 'lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml' 2026-02-14T10:26:52,541 adding 'lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml' 2026-02-14T10:26:52,542 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml' 2026-02-14T10:26:52,544 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml' 2026-02-14T10:26:52,545 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml' 2026-02-14T10:26:52,546 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml' 2026-02-14T10:26:52,547 adding 'lm_eval/tasks/zhoblimp/question_daodi_negation.yaml' 2026-02-14T10:26:52,548 adding 'lm_eval/tasks/zhoblimp/question_nandao_negation.yaml' 2026-02-14T10:26:52,549 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml' 2026-02-14T10:26:52,550 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml' 2026-02-14T10:26:52,552 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml' 2026-02-14T10:26:52,553 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml' 2026-02-14T10:26:52,554 adding 'lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml' 2026-02-14T10:26:52,555 adding 'lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml' 2026-02-14T10:26:52,556 adding 'lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml' 2026-02-14T10:26:52,557 adding 'lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml' 2026-02-14T10:26:52,559 adding 'lm_eval/tasks/zhoblimp/question_particle_nandao.yaml' 2026-02-14T10:26:52,560 adding 'lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml' 2026-02-14T10:26:52,561 adding 'lm_eval/tasks/zhoblimp/relative_operator_who.yaml' 2026-02-14T10:26:52,562 adding 'lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml' 2026-02-14T10:26:52,563 adding 'lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml' 2026-02-14T10:26:52,564 adding 'lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml' 2026-02-14T10:26:52,566 adding 'lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml' 2026-02-14T10:26:52,567 adding 'lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml' 2026-02-14T10:26:52,568 adding 'lm_eval/tasks/zhoblimp/right_yijing_a.yaml' 2026-02-14T10:26:52,569 adding 'lm_eval/tasks/zhoblimp/right_yijing_b.yaml' 2026-02-14T10:26:52,570 adding 'lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml' 2026-02-14T10:26:52,571 adding 'lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml' 2026-02-14T10:26:52,572 adding 'lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml' 2026-02-14T10:26:52,573 adding 'lm_eval/tasks/zhoblimp/topicalization_OSV.yaml' 2026-02-14T10:26:52,574 adding 'lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml' 2026-02-14T10:26:52,575 adding 'lm_eval/tasks/zhoblimp/topicalization_SOV.yaml' 2026-02-14T10:26:52,576 adding 'lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml' 2026-02-14T10:26:52,577 adding 'lm_eval/tasks/zhoblimp/verb_negation_particle.yaml' 2026-02-14T10:26:52,578 adding 'lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml' 2026-02-14T10:26:52,579 adding 'lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml' 2026-02-14T10:26:52,581 adding 'lm_eval/tasks/zhoblimp/ya_insertion.yaml' 2026-02-14T10:26:52,582 adding 'lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml' 2026-02-14T10:26:52,583 adding 'lm_eval/tasks/zhoblimp/you_yige.yaml' 2026-02-14T10:26:52,584 adding 'lm_eval/tasks/zhoblimp/zhoblimp_group.yaml' 2026-02-14T10:26:52,587 adding 'lm_eval-0.4.11.dist-info/licenses/LICENSE.md' 2026-02-14T10:26:52,593 adding 'lm_eval-0.4.11.dist-info/METADATA' 2026-02-14T10:26:52,594 adding 'lm_eval-0.4.11.dist-info/WHEEL' 2026-02-14T10:26:52,595 adding 'lm_eval-0.4.11.dist-info/entry_points.txt' 2026-02-14T10:26:52,596 adding 'lm_eval-0.4.11.dist-info/top_level.txt' 2026-02-14T10:26:52,853 adding 'lm_eval-0.4.11.dist-info/RECORD' 2026-02-14T10:26:53,116 removing build/bdist.linux-armv7l/wheel 2026-02-14T10:26:56,790 Building wheel for lm-eval (pyproject.toml): finished with status 'done' 2026-02-14T10:26:56,979 Created wheel for lm-eval: filename=lm_eval-0.4.11-py3-none-any.whl size=8744826 sha256=7a994cec7f884dff2892c895be7943f2e5daf899d1a0c96862a09e86d38317ef 2026-02-14T10:26:56,980 Stored in directory: /tmp/pip-ephem-wheel-cache-x4dg6j6q/wheels/e2/4d/54/3b72444edd8ccc562e991815cfd2e77f10163b408d8d641a16 2026-02-14T10:26:57,452 Successfully built lm-eval 2026-02-14T10:26:57,665 Removed build tracker: '/tmp/pip-build-tracker-shbdv7kg'